Jul 09 16:24:20 devstack cinder-volume[75554]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 16:24:20 devstack cinder-volume[75554]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:24:20 devstack cinder-volume[75554]: we strongly recommend against using it for new projects. Jul 09 16:24:20 devstack cinder-volume[75554]: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:24:20 devstack cinder-volume[75554]: framework. For more detail see Jul 09 16:24:20 devstack cinder-volume[75554]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:24:20 devstack cinder-volume[75554]: import eventlet # noqa Jul 09 16:24:22 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:24:22 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:24:22 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:24:23 devstack cinder-volume[75554]: INFO dbcounter [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Registered counter for database cinder Jul 09 16:24:23 devstack cinder-volume[75554]: DEBUG oslo_db.sqlalchemy.engines [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG dbcounter [-] [75554] Writer thread running {{(pid=75554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:24:24 devstack cinder-volume[75554]: INFO cinder.rpc [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 16:24:24 devstack cinder-volume[75554]: INFO cinder.rpc [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_db.sqlalchemy.engines [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:24:24 devstack cinder-volume[75554]: INFO cinder.volume.manager [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Determined volume DB was empty at startup. Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG cinder.volume.manager [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75554) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 16:24:24 devstack cinder-volume[75554]: INFO cinder.volume.manager [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 16:24:24 devstack cinder-volume[75554]: WARNING stevedore.named [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:24:24 devstack cinder-volume[75554]: WARNING castellan.key_manager [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:24:24 devstack cinder-volume[75554]: WARNING cinder.keymgr.conf_key_mgr [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG cinder.volume.drivers.lvm [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75554) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_concurrency.processutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] CMD "cinder-rtstool verify" returned: 0 in 0.369s {{(pid=75554) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_db.sqlalchemy.engines [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:24:24 devstack cinder-volume[75554]: INFO cinder.rpc [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 16:24:24 devstack cinder-volume[75554]: INFO cinder.rpc [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 16:24:24 devstack cinder-volume[75554]: WARNING stevedore.named [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:24:24 devstack cinder-volume[75554]: WARNING castellan.key_manager [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:24:24 devstack cinder-volume[75554]: INFO cinder.volume.manager [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_db.sqlalchemy.engines [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:24:24 devstack cinder-volume[75554]: INFO oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Starting 1 workers Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Started child 75716 {{(pid=75554) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Full set of CONF: {{(pid=75554) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] ******************************************************************************** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Configuration options gathered from: {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] ================================================================================ {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] allow_availability_zone_fallback = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] allow_compression_on_image_upload = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] allowed_direct_url_schemes = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] api_rate_limit = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] auth_strategy = keystone {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] az_cache_duration = 3600 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_availability_zone = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_host = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75716]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_stats_polling_interval = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backup_api_class = cinder.backup.api.API {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backup_name_template = backup-%s {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backup_use_same_host = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backup_use_temp_snapshot = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] chap_password = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] chap_username = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_internal_tenant_project_id = 23cdec19f3a4461dad472dbe905740d2 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_internal_tenant_user_id = 5fae1b4dc801425fab733a2f5d55f6b4 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cloned_volume_same_az = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cluster = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] compression_format = gzip {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] compute_api_class = cinder.compute.nova.API {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] config_dir = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] config_source = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] control_exchange = openstack {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] debug = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] default_availability_zone = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] default_group_type = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] default_volume_type = lvmdriver-1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] disk_geometry = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] driver_client_cert = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] driver_client_cert_key = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] driver_data_namespace = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] driver_ssl_cert_path = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] driver_ssl_cert_verify = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] driver_use_ssl = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] enable_force_upload = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] enable_new_services = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] enable_unsupported_driver = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] enforce_multipath_for_image_xfer = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] filter_function = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_api_insecure = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_api_servers = ['http://192.168.122.53/image'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_api_ssl_compression = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_ca_certificates_file = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_catalog_info = image:glance:publicURL {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_num_retries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance_request_timeout = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] goodness_function = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] graceful_shutdown_timeout = 5 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] group_api_class = cinder.group.api.API {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] host = devstack {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_compress_on_upload = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_conversion_address_space_limit = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_conversion_cpu_limit = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_conversion_disable = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_upload_use_cinder_backend = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_upload_use_internal_tenant = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_volume_cache_enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_volume_cache_max_count = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] image_volume_cache_max_size_gb = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] init_host_max_objects_retrieval = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] instance_format = [instance: %(uuid)s] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] iscsi_target_flags = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] iscsi_write_cache = on {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] iser_helper = tgtadm {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] iser_ip_address = 192.168.122.53 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] iser_port = 3260 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_color = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_config_append = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_dir = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_file = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_options = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_rotate_interval = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_rotate_interval_type = days {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] log_rotation_type = none {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] max_age = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] max_logfile_count = 30 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] max_logfile_size_mb = 200 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] max_over_subscription_ratio = 20.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] message_reap_interval = 86400 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] message_ttl = 2592000 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] migration_create_volume_timeout_secs = 300 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] monkey_patch = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] monkey_patch_modules = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] my_ip = 192.168.122.53 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] no_snapshot_gb_quota = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] num_iser_scan_tries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] num_shell_tries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] num_volume_device_scan_tries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] nvmeof_conn_info_version = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] nvmet_ns_id = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] nvmet_port_id = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] osapi_max_limit = 1000 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] osapi_volume_ext_list = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] osapi_volume_listen_port = 8776 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] osapi_volume_use_ssl = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] osapi_volume_workers = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] per_volume_size_limit = -1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] periodic_fuzzy_delay = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] periodic_interval = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] public_endpoint = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] publish_errors = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] quota_backup_gigabytes = 1000 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] quota_backups = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] quota_gigabytes = 1000 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:24 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] quota_groups = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] quota_snapshots = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] quota_volumes = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] rate_limit_burst = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] rate_limit_except_level = CRITICAL {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] rate_limit_interval = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] reinit_driver_count = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] replication_device = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:24 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] report_discard_supported = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] report_interval = 120 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] reservation_clean_interval = 86400 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] reservation_expire = 86400 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] reserved_image_namespaces = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] reserved_percentage = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] rpc_response_timeout = 120 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] run_external_periodic_tasks = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] scst_target_driver = iscsi {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] scst_target_iqn_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_down_time = 720 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] shell_completion = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] snapshot_name_template = snapshot-%s {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] snapshot_same_host = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] split_loggers = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] state_path = /opt/stack/data/cinder {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:25 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] storage_availability_zone = nova {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] storage_protocol = iSCSI {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] syslog_log_facility = LOG_USER {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] target_helper = lioadm {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] target_ip_address = 192.168.122.53 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] target_port = 3260 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] target_protocol = iscsi {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] target_secondary_ip_addresses = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] trace_flags = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] transport_url = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] until_refresh = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] use_chap_auth = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] use_default_quota_class = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] use_journal = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] use_json = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] use_multipath_for_image_xfer = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] use_stderr = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] use_syslog = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] verify_glance_signatures = enabled {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_api_class = cinder.volume.api.API {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_backend_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_clear = zero {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_clear_ionice = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_clear_size = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_copy_bps_limit = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_dd_blocksize = 1M {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_name_template = volume-%s {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_service_inithost_offload = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volume_usage_audit_period = month {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] zoning_mode = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_concurrency.disable_process_locking = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack sudo[75720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.auth_section = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack sudo[75720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.auth_type = password {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.auth_version = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.cache = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.include_service_catalog = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.insecure = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.interface = public {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_password = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcache_username = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.region_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.service_type = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.backend = dogpile.cache.null {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.backend_argument = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.backend_expiration_time = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.config_prefix = cache.oslo {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.debug_cache_backend = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.enable_retry_client = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.enable_socket_keepalive = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.expiration_time = 600 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.hashclient_retry_attempts = 2 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.memcache_dead_retry = 300 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.memcache_pool_maxsize = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.memcache_sasl_enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.password = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.proxies = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.redis_db = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.redis_server = localhost:6379 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.retry_attempts = 2 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.retry_delay = 0.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.socket_keepalive_count = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.socket_keepalive_idle = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.socket_keepalive_interval = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.socket_timeout = 1.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.tls_allowed_ciphers = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.tls_cafile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.tls_certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.tls_enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.tls_keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cache.username = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] coordination.backend_url = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.asyncio_connection = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.asyncio_slave_connection = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.backend = sqlalchemy {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.connection = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.connection_debug = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.connection_parameters = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.connection_recycle_time = 3600 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.connection_trace = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.db_inc_retry_interval = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.db_max_retries = 20 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.db_max_retry_interval = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.db_retry_interval = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.max_overflow = 50 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.max_pool_size = 5 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.max_retries = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.mysql_wsrep_sync_wait = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.pool_timeout = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.retry_interval = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.slave_connection = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.sqlite_synchronous = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.synchronous_reader = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] database.use_db_reconnect = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.connection_string = messaging:// {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.es_doc_type = notification {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.es_scroll_size = 10000 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.es_scroll_time = 2m {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.filter_error_trace = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.hmac_keys = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.sentinel_service_name = mymaster {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.socket_timeout = 0.1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.trace_requests = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler.trace_sqlalchemy = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler_jaeger.process_tags = {} {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler_jaeger.service_name_prefix = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] profiler_otlp.service_name_prefix = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.enforce_new_defaults = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.enforce_scope = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.policy_default_rule = default {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.policy_file = policy.yaml {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] privsep_osbrick.group = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] privsep_osbrick.helper_command = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] privsep_osbrick.user = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_sys_admin.group = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_sys_admin.helper_command = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] cinder_sys_admin.user = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.auth_section = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.auth_type = password {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.cafile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.collect_timing = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.insecure = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.send_service_user_token = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.split_loggers = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] service_user.timeout = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.auth_section = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.auth_type = password {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.collect_timing = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.insecure = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.region_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.split_loggers = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] glance.timeout = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.backend_availability_zone = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.chap_password = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.chap_username = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.disk_geometry = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.driver_client_cert = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.driver_client_cert_key = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.driver_data_namespace = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.driver_use_ssl = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.extra_capabilities = {} {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.filter_function = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.goodness_function = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.iscsi_target_flags = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.iscsi_write_cache = on {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.iser_helper = tgtadm {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.iser_port = 3260 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.lvm_share_target = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.lvm_type = auto {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.num_shell_tries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.replication_device = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.report_discard_supported = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.reserved_percentage = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.target_helper = tgtadm {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.target_port = 3260 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.target_protocol = iscsi {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.trace_flags = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.unique_fqdn_network = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.use_chap_auth = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_backend_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_clear = zero {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_clear_ionice = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_clear_size = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_reports.file_event_handler = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_reports.log_dir = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.backend_host = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.chap_password = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.chap_username = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.disk_geometry = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.driver_client_cert = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.extra_capabilities = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.filter_function = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.goodness_function = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.iser_helper = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.iser_ip_address = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.iser_port = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.lvm_share_target = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.lvm_type = auto {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.num_shell_tries = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.replication_device = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.report_discard_supported = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.reserved_percentage = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.scst_target_driver = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.storage_protocol = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.target_helper = lioadm {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.target_ip_address = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.target_port = 3260 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.trace_flags = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.use_chap_auth = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_clear = zero {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_clear_size = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] lvmdriver-1.volumes_dir = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.ssl = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_notifications.driver = [] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_notifications.retry = -1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] key_manager.fixed_key = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.barbican_api_version = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.barbican_endpoint = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.barbican_endpoint_type = public {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.barbican_region_name = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.cafile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.collect_timing = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.insecure = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.number_of_retries = 60 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.retry_delay = 1 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.send_service_user_token = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.split_loggers = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.timeout = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.verify_ssl = True {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican.verify_ssl_path = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.auth_section = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.auth_type = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.cafile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.certfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.collect_timing = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.insecure = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.keyfile = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.split_loggers = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] barbican_service_user.timeout = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.approle_role_id = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.approle_secret_id = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.kv_mountpoint = secret {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.kv_path = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.kv_version = 2 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.namespace = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.root_token_id = **** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.ssl_ca_crt_file = None {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.timeout = 60.0 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.use_ssl = False {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:24:25 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] ******************************************************************************** {{(pid=75554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 16:24:25 devstack sudo[75720]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:25 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:25 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:25 devstack sudo[75808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:25 devstack sudo[75808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:26 devstack sudo[75808]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:26 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.646s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:26 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:24:26 devstack cinder-volume[75716]: INFO cinder.brick.local_dev.lvm [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 16:24:26 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:26 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:26 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:26 devstack sudo[76029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:24:26 devstack sudo[76029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:27 devstack sudo[76029]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:27 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:27 devstack cinder-volume[75716]: DEBUG cinder.brick.local_dev.lvm [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75716) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 09 16:24:27 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:27 devstack sudo[76280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:27 devstack sudo[76280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:28 devstack sudo[76280]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:28 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.317s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:28 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:28 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:28 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:28 devstack sudo[76464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:28 devstack sudo[76464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:29 devstack sudo[76464]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.755s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:29 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 16:24:29 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:29 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.736s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:29 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:29 devstack sudo[76509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:24:29 devstack sudo[76509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:30 devstack sudo[76509]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:30 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.830s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:30 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:30 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:24:30 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:31 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:31 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.833s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:31 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:31 devstack sudo[76525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:24:31 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:32 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:32 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:32 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:32 devstack sudo[76531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:32 devstack sudo[76531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:32 devstack sudo[76531]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:32 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:32 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:33 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:33 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:33 devstack sudo[76539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:33 devstack sudo[76539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:33 devstack sudo[76539]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:33 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.800s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:33 devstack cinder-volume[75716]: INFO cinder.volume.drivers.lvm [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 16:24:33 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:33 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:33 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:33 devstack sudo[76625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:33 devstack sudo[76625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:34 devstack sudo[76625]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:34 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:34 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 09 16:24:34 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:34 devstack sudo[76665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:24:34 devstack sudo[76665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:34 devstack cinder-volume[75554]: DEBUG dbcounter [-] [75554] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:24:35 devstack sudo[76665]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:35 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:35 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:35 devstack sudo[76806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:24:35 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:35 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:35 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:35 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:35 devstack sudo[76809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:35 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:36 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:36 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:36 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:36 devstack sudo[76813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:24:36 devstack sudo[76813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:37 devstack sudo[76813]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:37 devstack cinder-volume[75716]: INFO cinder.volume.driver [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG cinder.volume.driver [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75716) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG oslo_db.sqlalchemy.engines [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75716) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writer thread running {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG cinder.db.api [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Building query based on filter {{(pid=75716) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG cinder.image.image_utils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75716) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 16:24:37 devstack cinder-volume[75716]: INFO cinder.keymgr.migration [None req-d62062e4-5cb0-4573-9c65-54b5a1ff051a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:37 devstack sudo[76817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:24:37 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:37 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:37 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:37 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:24:37 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:38 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:38 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:38 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:38 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:38 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:39 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.694s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:39 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:24:39 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:39 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:39 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:39 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:24:39 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Driver initialization completed successfully. Jul 09 16:24:39 devstack cinder-volume[75716]: INFO cinder.manager [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Initiating service 2 cleanup Jul 09 16:24:39 devstack cinder-volume[75716]: INFO cinder.manager [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Service 2 cleanup completed. Jul 09 16:24:39 devstack cinder-volume[75716]: DEBUG cinder.service [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Creating RPC server for service cinder-volume {{(pid=75716) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 16:24:39 devstack cinder-volume[75716]: DEBUG cinder.service [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75716) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 16:24:40 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 16:24:40 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 09 16:24:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:40 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:24:40 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:40 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:40 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:40 devstack sudo[76839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:24:40 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:41 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:41 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:41 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:41 devstack sudo[76899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:24:41 devstack sudo[76899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:42 devstack sudo[76899]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:42 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:42 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:24:42 devstack sudo[76902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:24:42 devstack sudo[76902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:24:42 devstack sudo[76902]: pam_unix(sudo:session): session closed for user root Jul 09 16:24:42 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:24:42 devstack cinder-volume[75716]: INFO cinder.volume.manager [None req-2ff1d2e5-e6c9-47d7-95e4-02b1423f4c59 None None] Driver post RPC initialization completed successfully. Jul 09 16:24:52 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:24:52 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:25:10 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running periodic task VolumeManager._thread_info {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:25:10 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread count: 6 {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:25:10 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread info: [<_MainThread(MainThread, started 140220112085120)>, , , , , ] {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:26:10 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:26:10 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 09 16:26:10 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:26:10 devstack sudo[79736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:26:10 devstack sudo[79736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:26:11 devstack sudo[79736]: pam_unix(sudo:session): session closed for user root Jul 09 16:26:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:26:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:26:11 devstack sudo[80101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:26:11 devstack sudo[80101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:26:12 devstack sudo[80101]: pam_unix(sudo:session): session closed for user root Jul 09 16:26:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:26:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:26:12 devstack sudo[80570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:26:12 devstack sudo[80570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:26:12 devstack sudo[80570]: pam_unix(sudo:session): session closed for user root Jul 09 16:26:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:26:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:26:12 devstack sudo[80937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:26:12 devstack sudo[80937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:26:13 devstack sudo[80937]: pam_unix(sudo:session): session closed for user root Jul 09 16:26:13 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:26:13 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:26:13 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running periodic task VolumeManager._thread_info {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:26:13 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread count: 6 {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:26:13 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread info: [<_MainThread(MainThread, started 140220112085120)>, , , , , ] {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:26:52 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:27:10 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:27:10 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 09 16:27:10 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:27:10 devstack sudo[83480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:27:10 devstack sudo[83480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:27:11 devstack sudo[83480]: pam_unix(sudo:session): session closed for user root Jul 09 16:27:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:27:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:27:11 devstack sudo[83525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:27:11 devstack sudo[83525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:27:12 devstack sudo[83525]: pam_unix(sudo:session): session closed for user root Jul 09 16:27:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:27:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:27:12 devstack sudo[83543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:27:12 devstack sudo[83543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:27:12 devstack sudo[83543]: pam_unix(sudo:session): session closed for user root Jul 09 16:27:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:27:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:27:12 devstack sudo[83557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:27:12 devstack sudo[83557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:27:13 devstack sudo[83557]: pam_unix(sudo:session): session closed for user root Jul 09 16:27:13 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:27:13 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:27:13 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running periodic task VolumeManager._thread_info {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:27:13 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread count: 6 {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:27:13 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread info: [<_MainThread(MainThread, started 140220112085120)>, , , , , ] {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:28:10 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:28:10 devstack cinder-volume[75716]: DEBUG cinder.volume.drivers.lvm [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Updating volume stats {{(pid=75716) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 09 16:28:10 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:28:10 devstack sudo[85091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 16:28:10 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:28:11 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root Jul 09 16:28:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:28:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:28:11 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:28:11 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:28:11 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Jul 09 16:28:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:28:11 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:28:12 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 16:28:12 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:28:12 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Jul 09 16:28:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:28:12 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:28:12 devstack sudo[85153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 16:28:12 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:28:13 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root Jul 09 16:28:13 devstack cinder-volume[75716]: DEBUG oslo_concurrency.processutils [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75716) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:28:13 devstack cinder-volume[75716]: DEBUG cinder.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Notifying Schedulers of capabilities ... {{(pid=75716) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:28:13 devstack cinder-volume[75716]: DEBUG oslo_service.periodic_task [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] Running periodic task VolumeManager._thread_info {{(pid=75716) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:28:13 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread count: 6 {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:28:13 devstack cinder-volume[75716]: DEBUG cinder.volume.manager [None req-3e61ba58-fbd7-40b5-8e60-17987c3e0903 None None] thread info: [<_MainThread(MainThread, started 140220112085120)>, , , , , ] {{(pid=75716) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:28:52 devstack cinder-volume[75716]: DEBUG dbcounter [-] [75716] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75716) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:29:01 devstack cinder-volume[75554]: INFO oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Caught SIGTERM, stopping children Jul 09 16:29:01 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Acquiring lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:29:01 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Acquired lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:29:01 devstack cinder-volume[75554]: DEBUG oslo_concurrency.lockutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Releasing lock "singleton_lock" {{(pid=75554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:29:01 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Stop services. {{(pid=75554) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 16:29:01 devstack cinder-volume[75554]: DEBUG oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Killing children. {{(pid=75554) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 16:29:01 devstack cinder-volume[75554]: INFO oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Waiting on 1 children to exit Jul 09 16:29:05 devstack cinder-volume[75716]: DEBUG oslo_concurrency.lockutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Acquiring lock "singleton_lock" {{(pid=75716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:29:05 devstack cinder-volume[75716]: DEBUG oslo_concurrency.lockutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Acquired lock "singleton_lock" {{(pid=75716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:29:05 devstack cinder-volume[75716]: DEBUG oslo_concurrency.lockutils [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Releasing lock "singleton_lock" {{(pid=75716) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:29:05 devstack cinder-volume[75716]: WARNING amqp [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:29:05 devstack cinder-volume[75716]: WARNING amqp [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:29:05 devstack cinder-volume[75554]: INFO oslo_service.backend._eventlet.service [None req-b5873b7b-3773-4372-8c96-6857f6934c33 None None] Child 75716 exited with status 0 Jul 09 16:29:05 devstack cinder-volume[86217]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 16:29:05 devstack cinder-volume[86217]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:29:05 devstack cinder-volume[86217]: we strongly recommend against using it for new projects. Jul 09 16:29:05 devstack cinder-volume[86217]: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:29:05 devstack cinder-volume[86217]: framework. For more detail see Jul 09 16:29:05 devstack cinder-volume[86217]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:29:05 devstack cinder-volume[86217]: import eventlet # noqa Jul 09 16:29:07 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:29:07 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:29:07 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:29:08 devstack cinder-volume[86217]: INFO dbcounter [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Registered counter for database cinder Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86217) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG dbcounter [-] [86217] Writer thread running {{(pid=86217) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:29:08 devstack cinder-volume[86217]: INFO cinder.rpc [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 16:29:08 devstack cinder-volume[86217]: INFO cinder.rpc [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86217) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:08 devstack cinder-volume[86217]: INFO cinder.volume.manager [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Determined volume DB was empty at startup. Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG cinder.volume.manager [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86217) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 16:29:08 devstack cinder-volume[86217]: INFO cinder.volume.manager [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 16:29:08 devstack cinder-volume[86217]: WARNING stevedore.named [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:29:08 devstack cinder-volume[86217]: WARNING castellan.key_manager [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:29:08 devstack cinder-volume[86217]: WARNING cinder.keymgr.conf_key_mgr [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:29:08 devstack cinder-volume[86217]: INFO cinder.volume.manager [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_db.sqlalchemy.engines [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86217) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:08 devstack cinder-volume[86217]: INFO oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Starting 1 workers Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Started child 86471 {{(pid=86217) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Full set of CONF: {{(pid=86217) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] ******************************************************************************** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Configuration options gathered from: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] ================================================================================ {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] allow_availability_zone_fallback = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] allow_compression_on_image_upload = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] allowed_direct_url_schemes = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86471]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] api_rate_limit = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] auth_strategy = keystone {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_host = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_stats_polling_interval = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backup_api_class = cinder.backup.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backup_name_template = backup-%s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backup_use_same_host = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backup_use_temp_snapshot = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] chap_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] chap_username = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_internal_tenant_project_id = 23cdec19f3a4461dad472dbe905740d2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_internal_tenant_user_id = 5fae1b4dc801425fab733a2f5d55f6b4 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cluster = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:08 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] compression_format = gzip {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] compute_api_class = cinder.compute.nova.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] config_dir = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] config_source = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] control_exchange = openstack {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] debug = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] default_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] default_group_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] default_volume_type = QuobyteHD {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] disk_geometry = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] driver_client_cert = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] driver_client_cert_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] driver_data_namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] driver_ssl_cert_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] driver_ssl_cert_verify = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] driver_use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] enable_new_services = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] enable_unsupported_driver = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] enabled_backends = ['QuobyteHD'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] enforce_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] filter_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_api_insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_api_servers = ['http://192.168.122.53/image'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_api_ssl_compression = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_ca_certificates_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_catalog_info = image:glance:publicURL {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_num_retries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance_request_timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] goodness_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] graceful_shutdown_timeout = 5 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] group_api_class = cinder.group.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] host = devstack {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_compress_on_upload = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_conversion_address_space_limit = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_conversion_cpu_limit = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_conversion_disable = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_upload_use_cinder_backend = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_upload_use_internal_tenant = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_volume_cache_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_volume_cache_max_count = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] image_volume_cache_max_size_gb = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] init_host_max_objects_retrieval = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] instance_format = [instance: %(uuid)s] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] iscsi_target_flags = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] iscsi_write_cache = on {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] iser_helper = tgtadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86471]: INFO cinder.volume.manager [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.remotefs [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86471) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] iser_ip_address = 192.168.122.53 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] iser_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_color = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_config_append = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_dir = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_options = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_rotate_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_rotate_interval_type = days {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] log_rotation_type = none {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] max_age = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] max_logfile_count = 30 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] max_logfile_size_mb = 200 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] max_over_subscription_ratio = 20.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] message_reap_interval = 86400 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] message_ttl = 2592000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] migration_create_volume_timeout_secs = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] monkey_patch = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] monkey_patch_modules = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] my_ip = 192.168.122.53 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] no_snapshot_gb_quota = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] num_iser_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] num_shell_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] num_volume_device_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] nvmeof_conn_info_version = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] nvmet_ns_id = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] nvmet_port_id = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] osapi_max_limit = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] osapi_volume_ext_list = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] osapi_volume_listen_port = 8776 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] osapi_volume_use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] osapi_volume_workers = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] per_volume_size_limit = -1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] periodic_fuzzy_delay = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] periodic_interval = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] public_endpoint = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] publish_errors = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] quota_backup_gigabytes = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] quota_backups = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] quota_gigabytes = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] quota_groups = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] quota_snapshots = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] quota_volumes = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] rate_limit_burst = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] rate_limit_except_level = CRITICAL {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] rate_limit_interval = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] reinit_driver_count = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] replication_device = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] report_discard_supported = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] report_interval = 120 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] reservation_clean_interval = 86400 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] reservation_expire = 86400 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] reserved_image_namespaces = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] reserved_percentage = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] rpc_response_timeout = 120 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] run_external_periodic_tasks = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] scst_target_driver = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] scst_target_iqn_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_down_time = 720 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] shell_completion = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] snapshot_name_template = snapshot-%s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] state_path = /opt/stack/data/cinder {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] storage_availability_zone = nova {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] storage_protocol = iSCSI {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] syslog_log_facility = LOG_USER {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] target_helper = lioadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] target_ip_address = 192.168.122.53 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] target_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] target_protocol = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] target_secondary_ip_addresses = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] trace_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] transport_url = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] until_refresh = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] use_chap_auth = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] use_default_quota_class = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] use_journal = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] use_json = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] use_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] use_stderr = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] use_syslog = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] verify_glance_signatures = enabled {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_api_class = cinder.volume.api.API {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_backend_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_clear = zero {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_clear_ionice = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_clear_size = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_copy_bps_limit = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_dd_blocksize = 1M {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_name_template = volume-%s {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_service_inithost_offload = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volume_usage_audit_period = month {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] zoning_mode = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_concurrency.disable_process_locking = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.auth_type = password {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.auth_version = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.cache = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.include_service_catalog = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.interface = public {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_password = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcache_username = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.region_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.service_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.backend = dogpile.cache.null {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.backend_argument = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.backend_expiration_time = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.config_prefix = cache.oslo {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.debug_cache_backend = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.enable_retry_client = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.enable_socket_keepalive = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.expiration_time = 600 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.hashclient_retry_attempts = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.memcache_dead_retry = 300 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.memcache_pool_maxsize = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.memcache_sasl_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.proxies = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.redis_db = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.redis_server = localhost:6379 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.retry_attempts = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.retry_delay = 0.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.socket_keepalive_count = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.socket_keepalive_idle = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.socket_keepalive_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.socket_timeout = 1.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.tls_allowed_ciphers = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.tls_cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.tls_certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.tls_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.tls_keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cache.username = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] coordination.backend_url = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.asyncio_connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.asyncio_slave_connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.backend = sqlalchemy {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.connection_debug = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.connection_parameters = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.connection_recycle_time = 3600 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.connection_trace = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.db_inc_retry_interval = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.db_max_retries = 20 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.db_max_retry_interval = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.db_retry_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.max_overflow = 50 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.max_pool_size = 5 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.max_retries = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.mysql_wsrep_sync_wait = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.pool_timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.retry_interval = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.slave_connection = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.sqlite_synchronous = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.synchronous_reader = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] database.use_db_reconnect = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.connection_string = messaging:// {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.es_doc_type = notification {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.es_scroll_size = 10000 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.es_scroll_time = 2m {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.filter_error_trace = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.hmac_keys = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.sentinel_service_name = mymaster {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.socket_timeout = 0.1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.trace_requests = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler.trace_sqlalchemy = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler_jaeger.process_tags = {} {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler_jaeger.service_name_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] profiler_otlp.service_name_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.enforce_new_defaults = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.enforce_scope = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.policy_default_rule = default {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.policy_file = policy.yaml {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86471) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 16:29:09 devstack cinder-volume[86471]: WARNING cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 16:29:09 devstack cinder-volume[86471]: WARNING cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Running cmd (subprocess): mount.quobyte {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] privsep_osbrick.group = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] privsep_osbrick.helper_command = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] privsep_osbrick.user = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_sys_admin.group = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_sys_admin.helper_command = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] cinder_sys_admin.user = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.auth_type = password {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.send_service_user_token = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] service_user.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.auth_type = password {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.region_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] glance.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.backend_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.chap_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.chap_username = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.disk_geometry = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.driver_client_cert = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.driver_client_cert_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.driver_data_namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.driver_use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.extra_capabilities = {} {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.filter_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.goodness_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.iscsi_target_flags = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.iscsi_write_cache = on {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.iser_helper = tgtadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.iser_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_host = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_login = admin {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_mount_options = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_private_key = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_share_path = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.num_shell_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.quobyte_volume_url = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.replication_device = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.report_discard_supported = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.reserved_percentage = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.target_helper = tgtadm {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.target_port = 3260 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.target_protocol = iscsi {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.trace_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.unique_fqdn_network = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.use_chap_auth = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_backend_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_clear = zero {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_clear_ionice = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_clear_size = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_reports.file_event_handler = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_reports.log_dir = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.backend_availability_zone = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.backend_host = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.chap_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.chap_username = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.chiscsi_conf = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.disk_geometry = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.driver_client_cert = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.driver_data_namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.driver_use_ssl = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.extra_capabilities = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.filter_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.goodness_function = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.iser_helper = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.iser_ip_address = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.iser_port = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.iser_target_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_host = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_login = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_mount_options = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_password = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_private_key = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_share_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_ssh_port = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.num_shell_tries = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.nvmet_port_id = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.replication_device = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.report_discard_supported = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.reserved_percentage = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.scst_target_driver = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.storage_protocol = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.target_helper = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.target_ip_address = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.target_port = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.target_prefix = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.target_protocol = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.trace_flags = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.use_chap_auth = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_clear = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_clear_size = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] QuobyteHD.volumes_dir = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_notifications.driver = [] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_notifications.retry = -1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] key_manager.fixed_key = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.barbican_api_version = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.barbican_endpoint = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.barbican_endpoint_type = public {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.barbican_region_name = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.number_of_retries = 60 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.retry_delay = 1 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.send_service_user_token = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.verify_ssl = True {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican.verify_ssl_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.auth_section = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.auth_type = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.cafile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.certfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.collect_timing = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.insecure = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.keyfile = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.split_loggers = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] barbican_service_user.timeout = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.approle_role_id = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.approle_secret_id = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.kv_mountpoint = secret {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.kv_path = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.kv_version = 2 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.namespace = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.root_token_id = **** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] CMD "mount.quobyte" returned: 1 in 0.104s {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.ssl_ca_crt_file = None {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.timeout = 60.0 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.use_ssl = False {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:09 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] ******************************************************************************** {{(pid=86217) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=86471) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:29:09 devstack cinder-volume[86471]: INFO cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 ... Jul 09 16:29:09 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 -c /etc/quobyte/client-cinder.cfg {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:09 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 -c /etc/quobyte/client-cinder.cfg Jul 09 16:29:09 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:10 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.750s {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:10 devstack cinder-volume[86471]: INFO cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 succeeded Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=86471) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.784s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:10 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:29:10 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:10 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.646s {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:10 devstack cinder-volume[86471]: INFO cinder.volume.driver [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Driver hasn't implemented _init_vendor_properties() Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG cinder.volume.driver [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86471) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_db.sqlalchemy.engines [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG dbcounter [-] [86471] Writer thread running {{(pid=86471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG cinder.db.api [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Building query based on filter {{(pid=86471) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG cinder.image.image_utils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86471) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 16:29:10 devstack cinder-volume[86471]: INFO cinder.keymgr.migration [None req-5094a66b-4e08-4da6-ab0a-a1679a36b61f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=86471) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=86471) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:29:10 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:10 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:29:10 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:11 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.670s {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG cinder.manager [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Notifying Schedulers of capabilities ... {{(pid=86471) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:29:11 devstack cinder-volume[86471]: INFO cinder.volume.manager [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Driver initialization completed successfully. Jul 09 16:29:11 devstack cinder-volume[86471]: INFO cinder.manager [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Initiating service 3 cleanup Jul 09 16:29:11 devstack cinder-volume[86471]: INFO cinder.manager [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Service 3 cleanup completed. Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG cinder.service [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Creating RPC server for service cinder-volume {{(pid=86471) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG cinder.service [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86471) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 16:29:11 devstack cinder-volume[86471]: INFO cinder.volume.manager [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=86471) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=86471) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:29:11 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:11 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:29:11 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:12 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:12 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.737s {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:12 devstack cinder-volume[86471]: INFO cinder.volume.manager [None req-53822ebe-7f7e-4e07-b64b-16c002e39e9b None None] Driver post RPC initialization completed successfully. Jul 09 16:29:16 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:29:16 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:29:16 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=86471) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:29:16 devstack cinder-volume[86471]: DEBUG cinder.volume.drivers.quobyte [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=86471) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:29:16 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:29:16 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:16 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:29:16 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:17 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:17 devstack cinder-volume[86471]: DEBUG oslo_concurrency.processutils [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.612s {{(pid=86471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:17 devstack cinder-volume[86471]: DEBUG cinder.manager [None req-97b62c7f-e7a8-4396-8357-22f6e60cb51f None None] Notifying Schedulers of capabilities ... {{(pid=86471) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:29:18 devstack cinder-volume[86217]: INFO oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Caught SIGTERM, stopping children Jul 09 16:29:18 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Acquiring lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:29:18 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Acquired lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:29:18 devstack cinder-volume[86217]: DEBUG oslo_concurrency.lockutils [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Releasing lock "singleton_lock" {{(pid=86217) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:29:18 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Stop services. {{(pid=86217) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 16:29:18 devstack cinder-volume[86217]: DEBUG oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Killing children. {{(pid=86217) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 16:29:18 devstack cinder-volume[86217]: INFO oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Waiting on 1 children to exit Jul 09 16:29:20 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Acquiring lock "singleton_lock" {{(pid=86471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:29:20 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Acquired lock "singleton_lock" {{(pid=86471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:29:20 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Releasing lock "singleton_lock" {{(pid=86471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:29:20 devstack cinder-volume[86471]: WARNING amqp [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:29:20 devstack cinder-volume[86471]: WARNING amqp [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 16:29:20 devstack cinder-volume[86217]: INFO oslo_service.backend._eventlet.service [None req-c1e93b0b-bf68-4311-a6fe-120bdebeacb0 None None] Child 86471 exited with status 0 Jul 09 16:29:20 devstack cinder-volume[86919]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 16:29:20 devstack cinder-volume[86919]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:29:20 devstack cinder-volume[86919]: we strongly recommend against using it for new projects. Jul 09 16:29:20 devstack cinder-volume[86919]: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:29:20 devstack cinder-volume[86919]: framework. For more detail see Jul 09 16:29:20 devstack cinder-volume[86919]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:29:20 devstack cinder-volume[86919]: import eventlet # noqa Jul 09 16:29:23 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 16:29:23 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 16:29:23 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 16:29:24 devstack cinder-volume[86919]: INFO dbcounter [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Registered counter for database cinder Jul 09 16:29:24 devstack cinder-volume[86919]: DEBUG oslo_db.sqlalchemy.engines [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG dbcounter [-] [86919] Writer thread running {{(pid=86919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:29:25 devstack cinder-volume[86919]: INFO cinder.rpc [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 16:29:25 devstack cinder-volume[86919]: INFO cinder.rpc [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_db.sqlalchemy.engines [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:25 devstack cinder-volume[86919]: INFO cinder.volume.manager [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Determined volume DB was empty at startup. Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG cinder.volume.manager [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86919) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 16:29:25 devstack cinder-volume[86919]: WARNING stevedore.named [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 16:29:25 devstack cinder-volume[86919]: WARNING castellan.key_manager [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:29:25 devstack cinder-volume[86919]: WARNING cinder.keymgr.conf_key_mgr [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 16:29:25 devstack cinder-volume[86919]: INFO cinder.volume.manager [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_db.sqlalchemy.engines [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:25 devstack cinder-volume[86919]: INFO oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Starting 1 workers Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Started child 87204 {{(pid=86919) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Full set of CONF: {{(pid=86919) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] ******************************************************************************** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] Configuration options gathered from: {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 16:29:25 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] ================================================================================ {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] allow_availability_zone_fallback = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] allow_compression_on_image_upload = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] allowed_direct_url_schemes = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] api_rate_limit = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] auth_strategy = keystone {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_availability_zone = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_host = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_stats_polling_interval = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[87204]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backup_api_class = cinder.backup.api.API {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backup_name_template = backup-%s {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backup_use_same_host = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backup_use_temp_snapshot = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] chap_password = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] chap_username = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_internal_tenant_project_id = 23cdec19f3a4461dad472dbe905740d2 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_internal_tenant_user_id = 5fae1b4dc801425fab733a2f5d55f6b4 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cluster = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] compression_format = gzip {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] compute_api_class = cinder.compute.nova.API {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] config_dir = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] config_source = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] control_exchange = openstack {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] debug = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] default_availability_zone = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] default_group_type = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] default_volume_type = QuobyteHD {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] disk_geometry = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] driver_client_cert = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] driver_client_cert_key = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] driver_data_namespace = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] driver_ssl_cert_path = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] driver_ssl_cert_verify = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] driver_use_ssl = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] enable_new_services = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] enable_unsupported_driver = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] enabled_backends = ['QuobyteHD'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] enforce_multipath_for_image_xfer = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] filter_function = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_api_insecure = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_api_servers = ['http://192.168.122.53/image'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_api_ssl_compression = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_ca_certificates_file = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_catalog_info = image:glance:publicURL {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_num_retries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance_request_timeout = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] goodness_function = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] graceful_shutdown_timeout = 5 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] group_api_class = cinder.group.api.API {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] host = devstack {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_compress_on_upload = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_conversion_address_space_limit = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_conversion_cpu_limit = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_conversion_disable = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_upload_use_cinder_backend = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_upload_use_internal_tenant = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_volume_cache_enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_volume_cache_max_count = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] image_volume_cache_max_size_gb = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] init_host_max_objects_retrieval = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] instance_format = [instance: %(uuid)s] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] iscsi_target_flags = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] iscsi_write_cache = on {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] iser_helper = tgtadm {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] iser_ip_address = 192.168.122.53 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] iser_port = 3260 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_color = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_config_append = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_dir = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_file = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_options = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_rotate_interval = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_rotate_interval_type = days {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] log_rotation_type = none {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] max_age = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] max_logfile_count = 30 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] max_logfile_size_mb = 200 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] max_over_subscription_ratio = 20.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] message_reap_interval = 86400 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] message_ttl = 2592000 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] migration_create_volume_timeout_secs = 300 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] monkey_patch = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] monkey_patch_modules = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] my_ip = 192.168.122.53 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] no_snapshot_gb_quota = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] num_iser_scan_tries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] num_shell_tries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] num_volume_device_scan_tries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] nvmeof_conn_info_version = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] nvmet_ns_id = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] nvmet_port_id = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] osapi_max_limit = 1000 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] osapi_volume_ext_list = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] osapi_volume_listen = 0.0.0.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] osapi_volume_listen_port = 8776 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] osapi_volume_use_ssl = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] osapi_volume_workers = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] per_volume_size_limit = -1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] periodic_fuzzy_delay = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] periodic_interval = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] project_id_regex = [0-9a-f\-]+ {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] public_endpoint = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] publish_errors = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] quota_backup_gigabytes = 1000 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] quota_backups = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] quota_gigabytes = 1000 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] quota_groups = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] quota_snapshots = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] quota_volumes = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] rate_limit_burst = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] rate_limit_except_level = CRITICAL {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] rate_limit_interval = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] reinit_driver_count = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] replication_device = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] report_discard_supported = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] report_interval = 120 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] reservation_clean_interval = 86400 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] reservation_expire = 86400 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] reserved_image_namespaces = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] reserved_percentage = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] rpc_response_timeout = 120 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] run_external_periodic_tasks = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] scst_target_driver = iscsi {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] scst_target_iqn_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_down_time = 720 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] shell_completion = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] snapshot_name_template = snapshot-%s {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] split_loggers = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] state_path = /opt/stack/data/cinder {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] storage_availability_zone = nova {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] storage_protocol = iSCSI {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] syslog_log_facility = LOG_USER {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] target_helper = lioadm {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] target_ip_address = 192.168.122.53 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] target_port = 3260 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] target_protocol = iscsi {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] target_secondary_ip_addresses = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] trace_flags = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] transfer_api_class = cinder.transfer.api.API {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] transport_url = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] until_refresh = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] use_chap_auth = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] use_default_quota_class = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] use_journal = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] use_json = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] use_multipath_for_image_xfer = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] use_stderr = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] use_syslog = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] verify_glance_signatures = enabled {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_api_class = cinder.volume.api.API {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_backend_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_clear = zero {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_clear_ionice = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_clear_size = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_copy_bps_limit = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_dd_blocksize = 1M {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_name_template = volume-%s {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_service_inithost_offload = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volume_usage_audit_period = month {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] zoning_mode = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_concurrency.disable_process_locking = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87204) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.auth_section = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.auth_type = password {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.auth_version = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.cache = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.delay_auth_decision = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.http_connect_timeout = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.include_service_catalog = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.insecure = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.interface = public {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_password = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcache_username = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.region_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.service_token_roles_required = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.service_type = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.token_cache_time = 300 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.backend = dogpile.cache.null {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.backend_argument = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.backend_expiration_time = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.config_prefix = cache.oslo {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.debug_cache_backend = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.enable_retry_client = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.enable_socket_keepalive = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.expiration_time = 600 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.hashclient_retry_attempts = 2 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.memcache_dead_retry = 300 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.memcache_pool_maxsize = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.memcache_sasl_enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.password = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.proxies = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.redis_db = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.redis_sentinel_service_name = mymaster {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.redis_server = localhost:6379 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.retry_attempts = 2 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.retry_delay = 0.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.socket_keepalive_count = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.socket_keepalive_idle = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.socket_keepalive_interval = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.socket_timeout = 1.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.tls_allowed_ciphers = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.tls_cafile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.tls_certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.tls_enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.tls_keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cache.username = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] coordination.backend_url = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.asyncio_connection = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.asyncio_slave_connection = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.backend = sqlalchemy {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.connection = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.connection_debug = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.connection_parameters = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.connection_recycle_time = 3600 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.connection_trace = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.db_inc_retry_interval = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.db_max_retries = 20 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.db_max_retry_interval = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.db_retry_interval = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.max_overflow = 50 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.max_pool_size = 5 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.max_retries = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.mysql_wsrep_sync_wait = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.pool_timeout = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.retry_interval = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.slave_connection = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.sqlite_synchronous = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.synchronous_reader = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] database.use_db_reconnect = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.connection_string = messaging:// {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.es_doc_type = notification {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.es_scroll_size = 10000 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.es_scroll_time = 2m {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.filter_error_trace = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.hmac_keys = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.sentinel_service_name = mymaster {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.socket_timeout = 0.1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.trace_requests = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler.trace_sqlalchemy = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler_jaeger.process_tags = {} {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler_jaeger.service_name_prefix = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] profiler_otlp.service_name_prefix = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.enforce_new_defaults = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.enforce_scope = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.policy_default_rule = default {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.policy_file = policy.yaml {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_policy.remote_timeout = 60.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] privsep_osbrick.group = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] privsep_osbrick.helper_command = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] privsep_osbrick.user = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_sys_admin.group = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_sys_admin.helper_command = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] cinder_sys_admin.user = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.auth_section = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.auth_type = password {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.cafile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.collect_timing = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.insecure = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.send_service_user_token = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.split_loggers = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] service_user.timeout = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.auth_section = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.auth_type = password {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.collect_timing = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.insecure = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.region_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.split_loggers = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] glance.timeout = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.backend_availability_zone = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.chap_password = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.chap_username = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.disk_geometry = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.driver_client_cert = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.driver_client_cert_key = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.driver_data_namespace = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.driver_use_ssl = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.enable_unsupported_driver = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.extra_capabilities = {} {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.filter_function = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.goodness_function = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.iscsi_target_flags = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.iscsi_write_cache = on {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.iser_helper = tgtadm {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.iser_port = 3260 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_host = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_login = admin {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_mount_options = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_password = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_private_key = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_share_path = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_ssh_port = 22 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.num_shell_tries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.nvmet_port_id = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.quobyte_client_cfg = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.quobyte_volume_url = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.replication_device = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.report_discard_supported = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.reserved_percentage = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.scst_target_driver = iscsi {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.scst_target_iqn_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.storage_protocol = iSCSI {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.target_helper = tgtadm {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.target_port = 3260 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.target_protocol = iscsi {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.trace_flags = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.unique_fqdn_network = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.use_chap_auth = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_backend_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_clear = zero {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_clear_ionice = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_clear_size = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_reports.file_event_handler = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_reports.log_dir = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.backend_availability_zone = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.backend_host = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.chap_password = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.chap_username = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.chiscsi_conf = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.disk_geometry = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.driver_client_cert = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87204) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.driver_client_cert_key = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.driver_data_namespace = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 16:29:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.driver_use_ssl = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Running cmd (subprocess): mount.quobyte {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.extra_capabilities = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.filter_function = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.goodness_function = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.iscsi_target_flags = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.iscsi_write_cache = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.iser_helper = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.iser_ip_address = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.iser_port = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.iser_target_prefix = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_host = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_login = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_mount_options = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_password = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_private_key = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_share_path = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_ssh_port = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.num_shell_tries = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nvmet_ns_id = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.nvmet_port_id = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.replication_device = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.report_discard_supported = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.reserved_percentage = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.scst_target_driver = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.storage_protocol = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.target_helper = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.target_ip_address = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.target_port = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.target_prefix = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.target_protocol = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.trace_flags = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.unique_fqdn_network = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.use_chap_auth = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_clear = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_clear_ionice = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_clear_size = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] QuobyteHD.volumes_dir = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.ssl = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.ssl_version = {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_notifications.driver = [] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_notifications.retry = -1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] oslo_messaging_notifications.transport_url = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] key_manager.fixed_key = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.barbican_api_version = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.barbican_endpoint = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.barbican_endpoint_type = public {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.barbican_region_name = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.cafile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.collect_timing = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.insecure = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.number_of_retries = 60 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.retry_delay = 1 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.send_service_user_token = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.split_loggers = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.timeout = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.verify_ssl = True {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican.verify_ssl_path = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.auth_section = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.auth_type = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.cafile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.certfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.collect_timing = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.insecure = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.keyfile = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.split_loggers = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] barbican_service_user.timeout = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.approle_role_id = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.approle_secret_id = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.kv_mountpoint = secret {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.kv_path = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.kv_version = 2 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.namespace = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.root_token_id = **** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.ssl_ca_crt_file = None {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.timeout = 60.0 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.use_ssl = False {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 16:29:26 devstack cinder-volume[86919]: DEBUG oslo_service.backend._eventlet.service [None req-147f6bf5-f6ed-4b30-998e-0636ab9705ff None None] ******************************************************************************** {{(pid=86919) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 16:29:27 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:27 devstack cinder-volume[87204]: INFO cinder.volume.driver [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.volume.driver [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_db.sqlalchemy.engines [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writer thread running {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.db.api [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Building query based on filter {{(pid=87204) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87204) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:27 devstack cinder-volume[87204]: INFO cinder.keymgr.migration [None req-04ad2f6b-20c7-4f70-8958-ad6fdb8a8bae None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 16:29:27 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:29:27 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:27 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.624s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:29:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Driver initialization completed successfully. Jul 09 16:29:27 devstack cinder-volume[87204]: INFO cinder.manager [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Initiating service 3 cleanup Jul 09 16:29:27 devstack cinder-volume[87204]: INFO cinder.manager [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Service 3 cleanup completed. Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.service [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Creating RPC server for service cinder-volume {{(pid=87204) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.service [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87204) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 16:29:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:29:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:29:28 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:29:28 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:29:28 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Jul 09 16:29:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:29:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b06b4b8-06fd-464a-98f6-cf531807f500 None None] Driver post RPC initialization completed successfully. Jul 09 16:29:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:29:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 6 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:29:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:29:35 devstack cinder-volume[86919]: DEBUG dbcounter [-] [86919] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:29:37 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:29:38 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Flow 'volume_create_manager' (c959b721-db60-4db0-b5f4-bdb03b48ce79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26c8869-4f11-460d-9743-61af8fa99ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26c8869-4f11-460d-9743-61af8fa99ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1610288006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649081331df341459c6b1e59153fbe38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:30:28Z,use_quota=True,user_id='9ecfc06b461d4c5683ed865e97b8f2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0915bc8-11ec-4de2-a956-afb70f43dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0915bc8-11ec-4de2-a956-afb70f43dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822dcf42-07e2-4ba0-81a2-8d60fde91b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822dcf42-07e2-4ba0-81a2-8d60fde91b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf', 'volume_name': 'volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce43db56-c4a9-4bc8-8561-aa9312643f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce43db56-c4a9-4bc8-8561-aa9312643f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a6a8ee-8614-4c4d-9e97-28e034712a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Volume c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf', 'volume_size': 1} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1610288006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649081331df341459c6b1e59153fbe38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:30:28Z,use_quota=True,user_id='9ecfc06b461d4c5683ed865e97b8f2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Creating volume c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:30:28 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:30:28 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf 1073741824 Jul 09 16:30:28 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:30:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:30:28 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:30:28 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:30:29 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Jul 09 16:30:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf 1073741824" returned: 0 in 1.145s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:30:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:30:29 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf Jul 09 16:30:29 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:30:29 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Jul 09 16:30:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.915s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:30:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:30:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:30:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 6 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:30:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:30:30 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Jul 09 16:30:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf" returned: 0 in 0.858s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:30:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:30:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:30:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a6a8ee-8614-4c4d-9e97-28e034712a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69e3a10-4bac-4f55-a061-3454c49be96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Volume volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf (c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf): created successfully Jul 09 16:30:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69e3a10-4bac-4f55-a061-3454c49be96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Flow 'volume_create_manager' (c959b721-db60-4db0-b5f4-bdb03b48ce79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:30:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-87127c58-8983-48e1-b50e-f2e677ace9a2 tempest-TaggedAttachmentsTest-1063285688 None] Created volume successfully. Jul 09 16:30:40 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:30:40 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Flow 'volume_create_manager' (8598a6b1-c846-4393-ba54-f754cd2a7908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913c3dc1-387f-4b13-be17-60ce267179e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913c3dc1-387f-4b13-be17-60ce267179e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1789854338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb76f50-1fa3-4fe3-8b97-bbe854bb3622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f827bb2fe86841f88d669f07c3d54ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:30:58Z,use_quota=True,user_id='ee5d1903ee7c4cc0b15978709dfcd797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aae0271-1eb7-495c-ad57-fa80b9c46c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aae0271-1eb7-495c-ad57-fa80b9c46c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe4cde0-5321-4091-a071-1e23e4e1ab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe4cde0-5321-4091-a071-1e23e4e1ab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb76f50-1fa3-4fe3-8b97-bbe854bb3622', 'volume_name': 'volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc9eee6-ed71-4e00-b0b5-1aaa4163cc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc9eee6-ed71-4e00-b0b5-1aaa4163cc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a31a4e-a767-4946-8ace-6c3f2d4f0c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:30:57 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Volume 5bb76f50-1fa3-4fe3-8b97-bbe854bb3622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622', 'volume_size': 1} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1789854338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb76f50-1fa3-4fe3-8b97-bbe854bb3622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f827bb2fe86841f88d669f07c3d54ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:30:58Z,use_quota=True,user_id='ee5d1903ee7c4cc0b15978709dfcd797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Creating volume 5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:30:57 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:30:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:30:57 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 1073741824 Jul 09 16:30:57 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:30:59 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Jul 09 16:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 1073741824" returned: 0 in 1.566s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:30:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:30:59 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 Jul 09 16:30:59 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:00 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622" returned: 0 in 1.316s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] <== create_volume: return (2994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:31:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a31a4e-a767-4946-8ace-6c3f2d4f0c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7144901c-1a8a-41d0-9199-20e54309f0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Volume volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 (5bb76f50-1fa3-4fe3-8b97-bbe854bb3622): created successfully Jul 09 16:31:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7144901c-1a8a-41d0-9199-20e54309f0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Flow 'volume_create_manager' (8598a6b1-c846-4393-ba54-f754cd2a7908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:31:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f786c428-5cb4-4631-93dd-5bc2d153f118 tempest-VolumesAdminNegativeTest-2092400487 None] Created volume successfully. Jul 09 16:31:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Acquiring lock "cinder-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:31:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "cinder-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:31:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Acquiring lock "cinder-quobyte-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:31:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "cinder-quobyte-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622" acquired by "delete_volume" :: waited 0.057s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:31:02 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy4n813yo/privsep.sock'] Jul 09 16:31:02 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy4n813yo/privsep.sock Jul 09 16:31:02 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 16:31:03 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 16:31:04 devstack cinder-volume[87204]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 16:31:05 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:05 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Spawned new privsep daemon via rootwrap Jul 09 16:31:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Accepted privsep connection to /tmp/tmpy4n813yo/privsep.sock {{(pid=87204) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 16:31:05 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 16:31:05 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 16:31:05 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 16:31:05 devstack cinder-volume[87204]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88262 Jul 09 16:31:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01214c3-6b38-4f2a-97b4-ad04b9842f0f]: (2,) {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:31:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db3ab6-ad63-4120-9772-45f84172778c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:31:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:06 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 Jul 09 16:31:06 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:07 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622" returned: 0 in 2.084s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:08 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622 Jul 09 16:31:08 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:09 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622" returned: 0 in 1.327s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "cinder-quobyte-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622" released by "delete_volume" :: held 6.690s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:31:09 devstack cinder-volume[87204]: WARNING cinder.quota [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:31:09 devstack cinder-volume[87204]: WARNING cinder.quota [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Created reservations ['7de93713-e726-49f3-8dac-0eca64cf2009', '7cd19171-fcbb-4cf1-bb01-573193c884bc', 'da5c93d2-dfcd-44c9-81db-852f7cf0b8b8', '9789efbf-00cc-4660-b6ca-12c1a7e41f6a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:09 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:31:09 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Flow 'volume_create_manager' (9347275a-4901-4376-a08c-b7bcd7171f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015c57cb-ec75-4165-8c08-2e1d4f17154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015c57cb-ec75-4165-8c08-2e1d4f17154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1267193150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745a3822-93d8-48d5-9eb0-55552b033ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5269d42ebb3479d92f493421459baee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:31:10Z,use_quota=True,user_id='4530c441b9b64730803ba0242e4d12dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9826f834-9f13-436c-955a-316859209121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9826f834-9f13-436c-955a-316859209121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966124ac-f84e-44d7-afd7-270a52907e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966124ac-f84e-44d7-afd7-270a52907e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745a3822-93d8-48d5-9eb0-55552b033ff2', 'volume_name': 'volume-745a3822-93d8-48d5-9eb0-55552b033ff2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cc6765-0230-433d-a418-e99c8515e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cc6765-0230-433d-a418-e99c8515e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472e9c0-4191-4d3b-af17-105630f0ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Volume 745a3822-93d8-48d5-9eb0-55552b033ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745a3822-93d8-48d5-9eb0-55552b033ff2', 'volume_size': 1} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1267193150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745a3822-93d8-48d5-9eb0-55552b033ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5269d42ebb3479d92f493421459baee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:31:10Z,use_quota=True,user_id='4530c441b9b64730803ba0242e4d12dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Creating volume 745a3822-93d8-48d5-9eb0-55552b033ff2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:31:10 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:31:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:11 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 1073741824 Jul 09 16:31:11 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:11 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.436s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:11 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:31:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Deleted volume successfully. Jul 09 16:31:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5e14fd5a-2128-479a-b5d1-f878f4e4c135 tempest-VolumesAdminNegativeTest-2092400487 None] Lock "cinder-5bb76f50-1fa3-4fe3-8b97-bbe854bb3622-delete_volume" released by "delete_volume" :: held 8.848s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:31:12 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 1073741824" returned: 0 in 1.694s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:12 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 Jul 09 16:31:12 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:13 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2" returned: 0 in 1.180s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] <== create_volume: return (2945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:31:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.950s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472e9c0-4191-4d3b-af17-105630f0ac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745a3822-93d8-48d5-9eb0-55552b033ff2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3611c179-4d62-4023-8056-bc9a420789c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Volume volume-745a3822-93d8-48d5-9eb0-55552b033ff2 (745a3822-93d8-48d5-9eb0-55552b033ff2): created successfully Jul 09 16:31:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3611c179-4d62-4023-8056-bc9a420789c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Flow 'volume_create_manager' (9347275a-4901-4376-a08c-b7bcd7171f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:31:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e7ba98ae-8ee6-41bb-97df-9ce87caab051 tempest-ServerRescueNegativeTestJSON-810469890 None] Created volume successfully. Jul 09 16:31:23 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=17,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:31:24 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:31:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:31:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:28 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:31:28 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:30 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.362s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:30 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:31:30 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:31:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:31:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:31:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Acquiring lock "cinder-745a3822-93d8-48d5-9eb0-55552b033ff2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:31:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "cinder-745a3822-93d8-48d5-9eb0-55552b033ff2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:31:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Acquiring lock "cinder-quobyte-745a3822-93d8-48d5-9eb0-55552b033ff2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:31:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "cinder-quobyte-745a3822-93d8-48d5-9eb0-55552b033ff2" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:31:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7473f2-b5bd-4c64-a908-e996aa8b4dc6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:31:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:35 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 Jul 09 16:31:35 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:36 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2" returned: 0 in 0.963s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:36 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2 Jul 09 16:31:36 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:37 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-745a3822-93d8-48d5-9eb0-55552b033ff2" returned: 0 in 0.695s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "cinder-quobyte-745a3822-93d8-48d5-9eb0-55552b033ff2" released by "delete_volume" :: held 1.718s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Created reservations ['423c96b7-03d3-4167-9fb1-23189ae8683d', '6593304d-f652-4550-abfe-1610e0aa1d91', 'c5a83636-bdcc-45b0-83a5-477ac862b6ad', '773c6e63-dbea-421b-a363-ab2842bd4090'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:37 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:31:37 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:38 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.163s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:38 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:31:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Deleted volume successfully. Jul 09 16:31:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d83bab75-6eb7-4d95-97c1-d9446e0b41f0 tempest-ServerRescueNegativeTestJSON-810469890 None] Lock "cinder-745a3822-93d8-48d5-9eb0-55552b033ff2-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Flow 'volume_create_manager' (8d9e90e8-2db9-4cb7-bd27-616e3b659536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d47e1f-ab38-4591-891a-32ad13da3e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d47e1f-ab38-4591-891a-32ad13da3e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1489957787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84827237-7d34-428c-a872-08fb71dcac42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c6fda6ca0a4f35ac2affd12d138c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:31:45Z,use_quota=True,user_id='c09375cf13234801b1a4d2f82dab5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb59f76-bc5c-4f10-bcb3-31af061f4b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb59f76-bc5c-4f10-bcb3-31af061f4b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3612ada1-5cc5-4b7e-9ddd-ec07071207ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3612ada1-5cc5-4b7e-9ddd-ec07071207ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84827237-7d34-428c-a872-08fb71dcac42', 'volume_name': 'volume-84827237-7d34-428c-a872-08fb71dcac42', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb97f1a-715c-437f-88bc-a4b24eef77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb97f1a-715c-437f-88bc-a4b24eef77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ee7c8-2ae7-427a-9270-bc206e969215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Volume 84827237-7d34-428c-a872-08fb71dcac42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84827237-7d34-428c-a872-08fb71dcac42', 'volume_size': 1} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1489957787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84827237-7d34-428c-a872-08fb71dcac42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c6fda6ca0a4f35ac2affd12d138c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:31:45Z,use_quota=True,user_id='c09375cf13234801b1a4d2f82dab5cfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Creating volume 84827237-7d34-428c-a872-08fb71dcac42 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:31:45 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:31:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:45 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 1073741824 Jul 09 16:31:45 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:46 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 1073741824" returned: 0 in 1.301s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:47 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 Jul 09 16:31:47 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:48 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42" returned: 0 in 1.284s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] <== create_volume: return (2664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:31:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.669s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ee7c8-2ae7-427a-9270-bc206e969215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84827237-7d34-428c-a872-08fb71dcac42', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44801888-313c-4cab-a215-0ca5b9ed1272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:31:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Volume volume-84827237-7d34-428c-a872-08fb71dcac42 (84827237-7d34-428c-a872-08fb71dcac42): created successfully Jul 09 16:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44801888-313c-4cab-a215-0ca5b9ed1272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:31:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Flow 'volume_create_manager' (8d9e90e8-2db9-4cb7-bd27-616e3b659536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:31:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e94d4584-5745-4ac1-ae8e-279ca236c566 tempest-DeleteServersTestJSON-1210448473 None] Created volume successfully. Jul 09 16:31:57 devstack cinder-volume[87204]: WARNING py.warnings [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 09 16:31:57 devstack cinder-volume[87204]: .first() Jul 09 16:31:57 devstack cinder-volume[87204]: Jul 09 16:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:31:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b5898-6501-4a1a-a6da-dc162cd2fb40]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:31:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:31:57 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 Jul 09 16:31:57 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:31:58 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Jul 09 16:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42" returned: 0 in 1.079s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:31:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:31:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-84827237-7d34-428c-a872-08fb71dcac42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb3d951c-5a6e-4026-ad63-151f2f53ab36', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:31:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-978be66c-d688-4b45-9938-d7cc99ed5bef req-b566fe74-e130-4218-88c9-58ca3a4db789 tempest-DeleteServersTestJSON-1210448473 None] attachment_update completed successfully. Jul 09 16:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-60ed7974-7443-4c48-886a-a830ab95d473 req-02765702-1585-4db5-9324-1e42b9cbb15d tempest-TaggedAttachmentsTest-1063285688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-60ed7974-7443-4c48-886a-a830ab95d473 req-02765702-1585-4db5-9324-1e42b9cbb15d tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa23d7a8-6a35-4397-9eea-059fc35e5b7a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-60ed7974-7443-4c48-886a-a830ab95d473 req-02765702-1585-4db5-9324-1e42b9cbb15d tempest-TaggedAttachmentsTest-1063285688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:01 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf Jul 09 16:32:01 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:02 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-60ed7974-7443-4c48-886a-a830ab95d473 req-02765702-1585-4db5-9324-1e42b9cbb15d tempest-TaggedAttachmentsTest-1063285688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf" returned: 0 in 1.024s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-60ed7974-7443-4c48-886a-a830ab95d473 req-02765702-1585-4db5-9324-1e42b9cbb15d tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.048s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-60ed7974-7443-4c48-886a-a830ab95d473 req-02765702-1585-4db5-9324-1e42b9cbb15d tempest-TaggedAttachmentsTest-1063285688 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebc4c66f-ab67-400e-9da3-effa42d88e7c', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:32:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-60ed7974-7443-4c48-886a-a830ab95d473 req-02765702-1585-4db5-9324-1e42b9cbb15d tempest-TaggedAttachmentsTest-1063285688 None] attachment_update completed successfully. Jul 09 16:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Flow 'volume_create_manager' (69b2f18e-bc9f-498f-8d59-bdee365282df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34aa8236-28c6-44c7-a6a8-56a50142f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34aa8236-28c6-44c7-a6a8-56a50142f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-352123319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2202f412-1b4f-4acf-8d23-d3043bc45eea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a2fc645b2064213b6aa9ee43128b2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:06Z,use_quota=True,user_id='7d442871e97a42f29e85499ed2a912ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74f4f48-e613-43a7-a07b-bdc43dc158f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74f4f48-e613-43a7-a07b-bdc43dc158f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8851105a-3d6d-40c8-b428-e26a87c732ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8851105a-3d6d-40c8-b428-e26a87c732ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2202f412-1b4f-4acf-8d23-d3043bc45eea', 'volume_name': 'volume-2202f412-1b4f-4acf-8d23-d3043bc45eea', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb556bce-6c2b-4821-a635-e7276800fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb556bce-6c2b-4821-a635-e7276800fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e29c6e5-45b8-48dd-960d-d51eda4fcc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Volume 2202f412-1b4f-4acf-8d23-d3043bc45eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2202f412-1b4f-4acf-8d23-d3043bc45eea', 'volume_size': 1} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-352123319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2202f412-1b4f-4acf-8d23-d3043bc45eea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a2fc645b2064213b6aa9ee43128b2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:06Z,use_quota=True,user_id='7d442871e97a42f29e85499ed2a912ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Creating volume 2202f412-1b4f-4acf-8d23-d3043bc45eea {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:32:06 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:06 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea 1073741824 Jul 09 16:32:06 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:06 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea 1073741824" returned: 0 in 0.884s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:06 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea Jul 09 16:32:06 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-00d965ad-c292-42f4-9f46-a05d3228ba5b req-ddde9e4f-9c78-44e3-8f95-03704691f943 tempest-DeleteServersTestJSON-1210448473 None] Terminate volume connection completed successfully. Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-00d965ad-c292-42f4-9f46-a05d3228ba5b req-ddde9e4f-9c78-44e3-8f95-03704691f943 tempest-DeleteServersTestJSON-1210448473 None] Deleting attachment bb3d951c-5a6e-4026-ad63-151f2f53ab36. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:32:07 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e29c6e5-45b8-48dd-960d-d51eda4fcc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2202f412-1b4f-4acf-8d23-d3043bc45eea', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5939e57-27d3-4a86-9006-11502391755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Volume volume-2202f412-1b4f-4acf-8d23-d3043bc45eea (2202f412-1b4f-4acf-8d23-d3043bc45eea): created successfully Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5939e57-27d3-4a86-9006-11502391755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Flow 'volume_create_manager' (69b2f18e-bc9f-498f-8d59-bdee365282df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-10b95e18-cc20-42fa-ae7b-4722a62e1e37 req-9bb68a7f-dceb-4435-9aa3-72495a22f917 tempest-VolumesGetTestJSON-695409163 None] Created volume successfully. Jul 09 16:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Acquiring lock "cinder-2202f412-1b4f-4acf-8d23-d3043bc45eea-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Lock "cinder-2202f412-1b4f-4acf-8d23-d3043bc45eea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Acquiring lock "cinder-quobyte-2202f412-1b4f-4acf-8d23-d3043bc45eea" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Lock "cinder-quobyte-2202f412-1b4f-4acf-8d23-d3043bc45eea" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c8f7c6-8afe-49e2-83d1-b2f0824976bc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:08 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea Jul 09 16:32:08 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:09 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea" returned: 0 in 0.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:09 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea Jul 09 16:32:09 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:10 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2202f412-1b4f-4acf-8d23-d3043bc45eea" returned: 0 in 0.684s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Lock "cinder-quobyte-2202f412-1b4f-4acf-8d23-d3043bc45eea" released by "delete_volume" :: held 1.749s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-3c6e084a-d90c-4e6d-916c-2d13e4a72e6c req-9c41de77-d965-4419-ab7b-3752536a005d tempest-TaggedAttachmentsTest-1063285688 None] Terminate volume connection completed successfully. Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-3c6e084a-d90c-4e6d-916c-2d13e4a72e6c req-9c41de77-d965-4419-ab7b-3752536a005d tempest-TaggedAttachmentsTest-1063285688 None] Deleting attachment ebc4c66f-ab67-400e-9da3-effa42d88e7c. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG cinder.quota [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Created reservations ['dae721d5-11d2-4ba4-8d89-76cdd3c546ba', '5dcf2070-2af4-4f8b-be27-c29b439ff419', '0b4db2bc-08dd-4eea-a6cc-da084d056016', '80238780-608e-40f6-8339-19ee549e443c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:10 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:32:10 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Acquiring lock "cinder-84827237-7d34-428c-a872-08fb71dcac42-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Lock "cinder-84827237-7d34-428c-a872-08fb71dcac42-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Acquiring lock "cinder-quobyte-84827237-7d34-428c-a872-08fb71dcac42" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Lock "cinder-quobyte-84827237-7d34-428c-a872-08fb71dcac42" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[612937bc-6411-4155-8b92-d0178f04db00]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:11 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 Jul 09 16:32:11 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:11 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG cinder.manager [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:32:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Deleted volume successfully. Jul 09 16:32:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-482ca41f-bd56-422f-984c-31679b1f74db req-ca162959-c716-4562-8f90-269bb49f9138 tempest-VolumesGetTestJSON-695409163 None] Lock "cinder-2202f412-1b4f-4acf-8d23-d3043bc45eea-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:12 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42" returned: 0 in 0.969s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:12 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42 Jul 09 16:32:12 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-84827237-7d34-428c-a872-08fb71dcac42" returned: 0 in 0.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Lock "cinder-quobyte-84827237-7d34-428c-a872-08fb71dcac42" released by "delete_volume" :: held 1.848s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:12 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Created reservations ['2241b704-b49f-4f9c-a02f-29433d405326', '0d959398-1126-4875-b171-fe055f43bfc6', 'bc34d8c5-e00d-436c-b131-41a08a5f7256', '85c27773-7ac3-4f41-9939-8921857eb311'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:13 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:32:13 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:14 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.312s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:32:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Deleted volume successfully. Jul 09 16:32:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20821819-3806-4126-9b64-1de88cbd9c5c tempest-DeleteServersTestJSON-1210448473 None] Lock "cinder-84827237-7d34-428c-a872-08fb71dcac42-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:23 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=30,cinder:INSERT=9,cinder:UPDATE=39,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:32:24 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=35,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Flow 'volume_create_manager' (c52a8ef9-af22-410a-bb70-e51bbd2feded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91066f3c-f0b8-4aae-ac4e-b44d63367e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91066f3c-f0b8-4aae-ac4e-b44d63367e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-680671994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114d8e64d85e45d5afa402b0ceef8bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:26Z,use_quota=True,user_id='02bdc40811604b42846616af62e26c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaab442-b87d-466c-aeda-856f5c2d7101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaab442-b87d-466c-aeda-856f5c2d7101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dd2528-4277-45eb-b05f-00dea8d8513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dd2528-4277-45eb-b05f-00dea8d8513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9', 'volume_name': 'volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cfdf51-896b-4114-89be-e9ef625ea0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cfdf51-896b-4114-89be-e9ef625ea0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b6923-c725-4baf-833c-2fa01ffc22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Volume 3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9', 'volume_size': 1} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-680671994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114d8e64d85e45d5afa402b0ceef8bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:26Z,use_quota=True,user_id='02bdc40811604b42846616af62e26c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Creating volume 3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:32:26 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:26 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 1073741824 Jul 09 16:32:26 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Flow 'volume_create_manager' (ddc1208f-7ef2-4096-80ce-90b8ae481e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597b44a4-6a51-44cb-8533-1548d0442522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597b44a4-6a51-44cb-8533-1548d0442522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-109634642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7758ce98-9d14-4b22-82eb-768ee48ee638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7938976152b34f9cbe7586f8ffd5a6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:27Z,use_quota=True,user_id='dd23745134e14532883da3646282e437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f91abf-5bce-4a30-8dd9-d0d3e0bd916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f91abf-5bce-4a30-8dd9-d0d3e0bd916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae671af7-9aa1-4c21-876f-411377099ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae671af7-9aa1-4c21-876f-411377099ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7758ce98-9d14-4b22-82eb-768ee48ee638', 'volume_name': 'volume-7758ce98-9d14-4b22-82eb-768ee48ee638', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cacb7cc-6e0a-41d3-812d-ef40c2f02f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cacb7cc-6e0a-41d3-812d-ef40c2f02f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d44210d-9d3d-4d2e-a7a2-cfddd828f717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Volume 7758ce98-9d14-4b22-82eb-768ee48ee638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7758ce98-9d14-4b22-82eb-768ee48ee638', 'volume_size': 1} Jul 09 16:32:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:27 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 1073741824" returned: 0 in 0.956s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:27 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 Jul 09 16:32:27 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:28 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-109634642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7758ce98-9d14-4b22-82eb-768ee48ee638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7938976152b34f9cbe7586f8ffd5a6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:27Z,use_quota=True,user_id='dd23745134e14532883da3646282e437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Creating volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:32:28 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b6923-c725-4baf-833c-2fa01ffc22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f730398-0ad3-41f4-b3b4-2a58708fb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:28 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 1073741824 Jul 09 16:32:28 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Volume volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 (3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9): created successfully Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f730398-0ad3-41f4-b3b4-2a58708fb824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Flow 'volume_create_manager' (c52a8ef9-af22-410a-bb70-e51bbd2feded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fa542b7b-5356-42b1-acf5-24b2d8b1e2f0 tempest-VolumesTestJSON-115705859 None] Created volume successfully. Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:28 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:32:28 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:29 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 1073741824" returned: 0 in 1.019s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:29 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:32:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:29 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 Jul 09 16:32:29 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Acquiring lock "cinder-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Lock "cinder-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:30 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d44210d-9d3d-4d2e-a7a2-cfddd828f717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7758ce98-9d14-4b22-82eb-768ee48ee638', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25de64af-b5e5-4a77-9be2-ac13b69859e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Volume volume-7758ce98-9d14-4b22-82eb-768ee48ee638 (7758ce98-9d14-4b22-82eb-768ee48ee638): created successfully Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25de64af-b5e5-4a77-9be2-ac13b69859e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Flow 'volume_create_manager' (ddc1208f-7ef2-4096-80ce-90b8ae481e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Acquiring lock "cinder-quobyte-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e00ee3e4-7573-4f91-8d5b-b8f48237a72f tempest-SnapshotsActionsTest-274007028 None] Created volume successfully. Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Lock "cinder-quobyte-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Flow 'volume_create_manager' (cfcd33d9-4510-4b79-a9f4-029b6fa5ffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3d0f70-2f97-4ec2-81b9-9fad58bafc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb648acb-d06d-4406-8f5e-61cd88f3ff7e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3d0f70-2f97-4ec2-81b9-9fad58bafc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-873461967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c246ef-26e6-441d-ac70-c52d7bf30638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114d8e64d85e45d5afa402b0ceef8bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:30Z,use_quota=True,user_id='02bdc40811604b42846616af62e26c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72e7c6a-7559-4cd5-a3e2-261b25574073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72e7c6a-7559-4cd5-a3e2-261b25574073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9422fa83-7f0b-4f17-ad08-f2c508def005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9422fa83-7f0b-4f17-ad08-f2c508def005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c246ef-26e6-441d-ac70-c52d7bf30638', 'volume_name': 'volume-28c246ef-26e6-441d-ac70-c52d7bf30638', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45d9c40-b336-409d-985b-1a12c6f53c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45d9c40-b336-409d-985b-1a12c6f53c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771c0bb1-ec6e-4901-a024-94c840720b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Volume 28c246ef-26e6-441d-ac70-c52d7bf30638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c246ef-26e6-441d-ac70-c52d7bf30638', 'volume_size': 1} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-873461967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c246ef-26e6-441d-ac70-c52d7bf30638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114d8e64d85e45d5afa402b0ceef8bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:30Z,use_quota=True,user_id='02bdc40811604b42846616af62e26c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Creating volume 28c246ef-26e6-441d-ac70-c52d7bf30638 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:32:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:30 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 1073741824 Jul 09 16:32:30 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:30 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf Jul 09 16:32:30 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:31 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:31 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf Jul 09 16:32:31 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:31 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 1073741824" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:31 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 Jul 09 16:32:31 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:31 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf" returned: 0 in 0.630s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Lock "cinder-quobyte-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf" released by "delete_volume" :: held 1.514s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Created reservations ['03029384-d29a-4421-b5f9-5bb689eef57d', '0a4a5399-f0e6-4476-81c0-9be94691709f', '2cc8480d-7583-402b-878b-a00938752d7b', '1ef8c927-e1a9-4007-b8c9-286bc7c29f5c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:32 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638" returned: 0 in 0.661s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.116s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:32 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:32:32 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771c0bb1-ec6e-4901-a024-94c840720b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c246ef-26e6-441d-ac70-c52d7bf30638', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6042dd3-471e-4517-a367-7f6a782c1103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Creating offline snapshot 75ad5101-8b3f-41d2-83d6-ef13a63427af of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:32:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Volume volume-28c246ef-26e6-441d-ac70-c52d7bf30638 (28c246ef-26e6-441d-ac70-c52d7bf30638): created successfully Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6042dd3-471e-4517-a367-7f6a782c1103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Flow 'volume_create_manager' (cfcd33d9-4510-4b79-a9f4-029b6fa5ffc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a24d0c-c15c-4964-807f-25f5fb783694]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e85c780a-198e-482a-b7d0-d606cd2d863e tempest-VolumesTestJSON-115705859 None] Created volume successfully. Jul 09 16:32:32 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 Jul 09 16:32:32 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:32 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.717s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:32:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Deleted volume successfully. Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-172ddb5a-9af8-4e13-9ea9-0eb0397f1e99 tempest-TaggedAttachmentsTest-1063285688 None] Lock "cinder-c96aa5d6-e44b-41fe-a74e-ac9a5e32dfbf-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:32 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:32 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af 1G Jul 09 16:32:32 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Flow 'volume_create_manager' (1365e4ff-39a0-4fad-986f-ccea41e9a687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce49516-e1c5-4d42-a3cb-059554f13c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce49516-e1c5-4d42-a3cb-059554f13c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-909716248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3c47de-0a86-44f4-afe1-0283ade65189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114d8e64d85e45d5afa402b0ceef8bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:33Z,use_quota=True,user_id='02bdc40811604b42846616af62e26c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84008d56-7879-46e3-a866-0f53b98a397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84008d56-7879-46e3-a866-0f53b98a397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ce3b33-ccfb-42da-a80d-a0c405dc4c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ce3b33-ccfb-42da-a80d-a0c405dc4c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3c47de-0a86-44f4-afe1-0283ade65189', 'volume_name': 'volume-8a3c47de-0a86-44f4-afe1-0283ade65189', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54971325-a30d-4bc3-960f-4a6976a83139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54971325-a30d-4bc3-960f-4a6976a83139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84cdbb6-5fdf-410d-b7fd-51d43eeb321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Volume 8a3c47de-0a86-44f4-afe1-0283ade65189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3c47de-0a86-44f4-afe1-0283ade65189', 'volume_size': 1} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:33 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af 1G" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:33 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:32:33 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:34 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.758s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:34 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af is being set with open permissions: ugo+rw Jul 09 16:32:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:34 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:32:34 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:35 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:35 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.info Jul 09 16:32:35 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:36 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.info" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:36 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.info is being set with open permissions: ugo+rw Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:36 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.info Jul 09 16:32:36 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:36 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.info" returned: 0 in 0.691s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.644s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.586s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-909716248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3c47de-0a86-44f4-afe1-0283ade65189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114d8e64d85e45d5afa402b0ceef8bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:33Z,use_quota=True,user_id='02bdc40811604b42846616af62e26c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Creating volume 8a3c47de-0a86-44f4-afe1-0283ade65189 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:32:36 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:32:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:36 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 1073741824 Jul 09 16:32:36 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-14d6fb58-0557-458a-890f-1764ab95385f tempest-SnapshotsActionsTest-274007028 None] Create snapshot completed successfully Jul 09 16:32:37 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 1073741824" returned: 0 in 1.013s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:37 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 Jul 09 16:32:37 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:38 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189" returned: 0 in 0.724s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.655s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Creating offline snapshot 11f663d8-a9a0-4a8a-953f-897dc6581d6e of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a84cdbb6-5fdf-410d-b7fd-51d43eeb321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3c47de-0a86-44f4-afe1-0283ade65189', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31576c44-a753-47a4-9d03-5679fec40375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f46194f-70ee-45c0-acce-45adc57d2fec]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Volume volume-8a3c47de-0a86-44f4-afe1-0283ade65189 (8a3c47de-0a86-44f4-afe1-0283ade65189): created successfully Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31576c44-a753-47a4-9d03-5679fec40375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Flow 'volume_create_manager' (1365e4ff-39a0-4fad-986f-ccea41e9a687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9dec2fbf-170e-4e9c-970d-bea7e2bf8b7f tempest-VolumesTestJSON-115705859 None] Created volume successfully. Jul 09 16:32:38 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:32:38 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:39 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:32:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:39 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e 1G Jul 09 16:32:39 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:40 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e 1G" returned: 0 in 1.128s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:40 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e Jul 09 16:32:40 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Acquiring lock "cinder-8a3c47de-0a86-44f4-afe1-0283ade65189-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Lock "cinder-8a3c47de-0a86-44f4-afe1-0283ade65189-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Acquiring lock "cinder-quobyte-8a3c47de-0a86-44f4-afe1-0283ade65189" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Lock "cinder-quobyte-8a3c47de-0a86-44f4-afe1-0283ade65189" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc8aab9-b3d1-472b-b762-81be7ccb0f5d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Flow 'volume_create_manager' (ed1a5e96-8290-4b0d-983b-5dd7e21b4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d487fe7-224e-48a1-806c-fe7a76253c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d487fe7-224e-48a1-806c-fe7a76253c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2013866738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a656f7-ef3f-4034-801c-48ebd93b09a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99c65920f7a4348bca95628212ade44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:41Z,use_quota=True,user_id='86ff014599b74c47b866d23d6e6c62a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:41 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 Jul 09 16:32:41 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d97821-b6d5-46be-ae44-2d6c8e7c8ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d97821-b6d5-46be-ae44-2d6c8e7c8ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7445fac-5ef7-4db8-8911-471159d692ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7445fac-5ef7-4db8-8911-471159d692ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a656f7-ef3f-4034-801c-48ebd93b09a2', 'volume_name': 'volume-70a656f7-ef3f-4034-801c-48ebd93b09a2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a59c7b-cff8-4c83-bd1c-549d84e656cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a59c7b-cff8-4c83-bd1c-549d84e656cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c8753a-f578-4424-b225-2a370ec1d055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Volume 70a656f7-ef3f-4034-801c-48ebd93b09a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a656f7-ef3f-4034-801c-48ebd93b09a2', 'volume_size': 1} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:41 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e" returned: 0 in 1.033s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:41 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e is being set with open permissions: ugo+rw Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:41 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e Jul 09 16:32:41 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:41 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189" returned: 0 in 0.978s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:41 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189 Jul 09 16:32:41 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:42 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e" returned: 0 in 0.801s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.027s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2013866738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a656f7-ef3f-4034-801c-48ebd93b09a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99c65920f7a4348bca95628212ade44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:32:41Z,use_quota=True,user_id='86ff014599b74c47b866d23d6e6c62a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Creating volume 70a656f7-ef3f-4034-801c-48ebd93b09a2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:32:42 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:42 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 1073741824 Jul 09 16:32:42 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-15946795-bfce-408d-81a4-c1553453fa0b tempest-SnapshotsActionsTest-274007028 None] Create snapshot completed successfully Jul 09 16:32:42 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8a3c47de-0a86-44f4-afe1-0283ade65189" returned: 0 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Lock "cinder-quobyte-8a3c47de-0a86-44f4-afe1-0283ade65189" released by "delete_volume" :: held 1.796s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Created reservations ['6a912cde-ac50-4762-a49a-a9963ed0abe4', 'a8fcb3d3-f23e-449e-8573-1cccc7308779', '27bf45ad-4c5d-4cb8-ac50-694415cff97d', 'e7571b2b-6018-4a42-bf9e-a20ad7650818'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:42 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:32:42 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Acquiring lock "cinder-28c246ef-26e6-441d-ac70-c52d7bf30638-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Lock "cinder-28c246ef-26e6-441d-ac70-c52d7bf30638-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Acquiring lock "cinder-quobyte-28c246ef-26e6-441d-ac70-c52d7bf30638" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Lock "cinder-quobyte-28c246ef-26e6-441d-ac70-c52d7bf30638" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917fada-776a-4828-bef5-4c17d668a1e2]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:43 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 Jul 09 16:32:43 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-11f663d8-a9a0-4a8a-953f-897dc6581d6e-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-11f663d8-a9a0-4a8a-953f-897dc6581d6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-11f663d8-a9a0-4a8a-953f-897dc6581d6e" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-11f663d8-a9a0-4a8a-953f-897dc6581d6e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Deleting offline snapshot 11f663d8-a9a0-4a8a-953f-897dc6581d6e of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] snapshot_file for this snap is: volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6faf3-3bc9-4f16-a54b-b0f960a3fd73]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:43 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e Jul 09 16:32:43 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:43 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 1073741824" returned: 0 in 1.325s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:43 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.162s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:32:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Deleted volume successfully. Jul 09 16:32:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:44 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 Jul 09 16:32:44 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a13de83-c26a-4c82-b5b1-cbda98678726 tempest-VolumesTestJSON-115705859 None] Lock "cinder-8a3c47de-0a86-44f4-afe1-0283ade65189-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:44 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638" returned: 0 in 1.311s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:44 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638 Jul 09 16:32:44 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:44 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e" returned: 0 in 1.090s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:32:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fff9c9-e8e2-41aa-9bee-e98b2fdcd3b9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:44 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:32:44 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:45 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2" returned: 0 in 1.265s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] <== create_volume: return (2686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c8753a-f578-4424-b225-2a370ec1d055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a656f7-ef3f-4034-801c-48ebd93b09a2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536e98a8-7fd9-4712-89fc-2226062f695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:32:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Volume volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 (70a656f7-ef3f-4034-801c-48ebd93b09a2): created successfully Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536e98a8-7fd9-4712-89fc-2226062f695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Flow 'volume_create_manager' (ed1a5e96-8290-4b0d-983b-5dd7e21b4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:32:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f8912e05-71a6-4ff3-8bb1-43994452972c tempest-ServerActionsTestOtherA-151165605 None] Created volume successfully. Jul 09 16:32:45 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28c246ef-26e6-441d-ac70-c52d7bf30638" returned: 0 in 1.115s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Lock "cinder-quobyte-28c246ef-26e6-441d-ac70-c52d7bf30638" released by "delete_volume" :: held 2.495s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:45 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 1.007s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:45 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e Jul 09 16:32:45 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Created reservations ['81c67475-a928-4799-800b-cdd057b38bfa', '383185a0-a8b3-4733-856d-5db20596cf57', 'dedb7b39-7468-423e-a314-260de902a575', '49d571ec-be7e-443a-bf7f-3b988d50e0d1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:45 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:32:45 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:46 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Acquiring lock "cinder-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:32:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Deleted volume successfully. Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Lock "cinder-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-345b9a12-351f-4272-9070-fc3f9bb0f23b tempest-VolumesTestJSON-115705859 None] Lock "cinder-28c246ef-26e6-441d-ac70-c52d7bf30638-delete_volume" released by "delete_volume" :: held 3.496s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Acquiring lock "cinder-quobyte-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Lock "cinder-quobyte-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:46 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e" returned: 0 in 0.988s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a3c7ab-15c4-4a83-82a5-deb60d5553cd]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:46 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e Jul 09 16:32:46 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:46 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 Jul 09 16:32:46 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:47 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.11f663d8-a9a0-4a8a-953f-897dc6581d6e" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-11f663d8-a9a0-4a8a-953f-897dc6581d6e" released by "_delete_snapshot" :: held 3.912s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" released by "delete_snapshot" :: held 3.939s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:47 devstack cinder-volume[87204]: WARNING cinder.quota [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:32:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Created reservations ['62dbb12e-ca20-4e70-ba2f-3ef43f2ec3be', '09a44bb3-323e-4f6f-9e81-3864f68080e8', '08201b91-cb0d-4cc9-8adc-4002b95358fe', 'b18e4530-a31d-4856-ad91-3eb329952603'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:47 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9" returned: 0 in 0.875s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Delete snapshot completed successfully. Jul 09 16:32:47 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9 Jul 09 16:32:47 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a461036c-1d4d-4d85-89c2-059d15e3107d tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-11f663d8-a9a0-4a8a-953f-897dc6581d6e-delete_snapshot" released by "delete_snapshot" :: held 4.145s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Creating offline snapshot 31333881-8643-46f5-9827-89ca4e5fbf05 of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[973a54f2-d4c4-4c6d-8ec5-4a01c3828c88]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:48 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:32:48 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:48 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9" returned: 0 in 0.695s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Lock "cinder-quobyte-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9" released by "delete_volume" :: held 1.630s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Created reservations ['48fc7434-153d-48f1-9489-8a54872ad576', '8e68e334-e084-4036-88b3-18a929b5a7a0', 'f9fe7258-be7f-4d0d-8b1f-52aabc03c00b', 'c660127d-d5c6-41cb-8189-b8e7a9c66c38'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:48 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:32:48 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:49 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.994s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:32:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:49 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 1G Jul 09 16:32:49 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:49 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:32:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Deleted volume successfully. Jul 09 16:32:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b5b0e73-00ce-48ef-86f8-3d496d30aa14 tempest-VolumesTestJSON-115705859 None] Lock "cinder-3ac0fe0a-c7e5-4f9d-8c33-7d11afd498c9-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:50 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 1G" returned: 0 in 1.047s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:50 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 Jul 09 16:32:50 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:51 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:51 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 is being set with open permissions: ugo+rw Jul 09 16:32:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:51 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 Jul 09 16:32:51 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:52 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05" returned: 0 in 1.055s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.989s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:32:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5f9393f2-ff0e-42b5-a3d2-b9de2c7c9582 tempest-SnapshotsActionsTest-274007028 None] Create snapshot completed successfully Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-31333881-8643-46f5-9827-89ca4e5fbf05-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-31333881-8643-46f5-9827-89ca4e5fbf05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-31333881-8643-46f5-9827-89ca4e5fbf05" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-31333881-8643-46f5-9827-89ca4e5fbf05" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Deleting offline snapshot 31333881-8643-46f5-9827-89ca4e5fbf05 of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] snapshot_file for this snap is: volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfb0273-39cb-4783-99fd-349f26003bd9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:52 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 Jul 09 16:32:52 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:53 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05" returned: 0 in 1.064s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:32:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5784fb83-8848-4dab-a247-bc734b0e26f0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:54 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:32:54 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:54 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:32:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:54 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 Jul 09 16:32:54 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:55 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05" returned: 0 in 0.937s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:55 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05 Jul 09 16:32:55 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:56 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.31333881-8643-46f5-9827-89ca4e5fbf05" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-31333881-8643-46f5-9827-89ca4e5fbf05" released by "_delete_snapshot" :: held 3.795s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" released by "delete_snapshot" :: held 3.821s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:56 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Created reservations ['e02df53b-a7da-466c-9e89-4402f764d7e8', '6710234c-9036-4b93-8df8-1a6e7fb682c3', 'edd85714-1844-4c6d-b0a8-3fc86ab10b44', '27a3b076-1306-4e32-8db7-f422c6082849'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:32:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Delete snapshot completed successfully. Jul 09 16:32:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-544f6cf6-4983-4f7c-b6bd-f3e1e4337648 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-31333881-8643-46f5-9827-89ca4e5fbf05-delete_snapshot" released by "delete_snapshot" :: held 3.983s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:32:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:32:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:32:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Creating offline snapshot 9749a634-bd65-43c7-809f-be6329aec86b of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:32:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5814b6f4-7604-4493-933b-a42783bccd05]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:32:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:57 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:32:57 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:58 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 1.069s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:32:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:58 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b 1G Jul 09 16:32:58 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:59 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Jul 09 16:32:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b 1G" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:32:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:32:59 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b Jul 09 16:32:59 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:32:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2fb6576f-b651-4ff5-80ed-a472cec8c349 tempest-BackendsCapabilitiesAdminTestsJSON-1914065450 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 16:33:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dcb73e6c-32ab-4b07-b2d6-5dc953d39d7a tempest-BackendsCapabilitiesAdminTestsJSON-1914065450 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 16:33:00 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:00 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b is being set with open permissions: ugo+rw Jul 09 16:33:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:00 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b Jul 09 16:33:00 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:01 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.652s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-102e2a01-8927-4984-9c4f-1d831c833605 tempest-SnapshotsActionsTest-274007028 None] Create snapshot completed successfully Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-9749a634-bd65-43c7-809f-be6329aec86b-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-9749a634-bd65-43c7-809f-be6329aec86b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-9749a634-bd65-43c7-809f-be6329aec86b" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-9749a634-bd65-43c7-809f-be6329aec86b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Deleting offline snapshot 9749a634-bd65-43c7-809f-be6329aec86b of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] snapshot_file for this snap is: volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2087b250-ad8c-44c9-ad11-974e5c5d245f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:02 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b Jul 09 16:33:02 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:02 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b" returned: 0 in 0.878s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e59635-94a2-4a6f-b68c-8111f0c2f5f3]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:02 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:33:02 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:03 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.943s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:03 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b Jul 09 16:33:03 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:05 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b" returned: 0 in 1.251s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:05 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b Jul 09 16:33:05 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:05 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.9749a634-bd65-43c7-809f-be6329aec86b" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-9749a634-bd65-43c7-809f-be6329aec86b" released by "_delete_snapshot" :: held 4.042s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" released by "delete_snapshot" :: held 4.081s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:06 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Created reservations ['5c6dc1f9-1845-44a3-bf36-af3f8b2e168c', '10177aec-5a52-4259-b573-2c7e03d5d0df', 'f8105593-5f00-4ed2-af44-6ed1d93f7f2a', 'd7d3b399-7975-41f6-b038-f84f77dfb74f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Delete snapshot completed successfully. Jul 09 16:33:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7481a91f-36e6-4eeb-9432-d20ff32c9a44 tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-9749a634-bd65-43c7-809f-be6329aec86b-delete_snapshot" released by "delete_snapshot" :: held 4.302s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-92c6e1dc-2729-44ba-8520-241967e34012 tempest-GroupSnapshotsV319Test-884635 None] Group tempest-GroupSnapshotsV319Test-Group-1489119164: creating Jul 09 16:33:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-92c6e1dc-2729-44ba-8520-241967e34012 tempest-GroupSnapshotsV319Test-884635 None] Group tempest-GroupSnapshotsV319Test-Group-1489119164: created successfully Jul 09 16:33:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-92c6e1dc-2729-44ba-8520-241967e34012 tempest-GroupSnapshotsV319Test-884635 None] Create group completed successfully. Jul 09 16:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Creating offline snapshot b0606738-6573-448e-89fd-b99f66dbf948 of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:33:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0a715-3e2d-4069-a3ab-d809f5b44b89]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:08 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:33:08 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:09 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 1.352s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:09 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 1G Jul 09 16:33:09 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Flow 'volume_create_manager' (29cf4271-69fb-4b8b-afe7-599701d1e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1232bff3-324f-4bf5-94d8-800e4cde1a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1232bff3-324f-4bf5-94d8-800e4cde1a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1077331786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1ec853b-aa13-4f6b-a845-3bf95690161e,host='devstack@QuobyteHD#QuobyteHD',id=292f14dd-9ef1-4b06-9682-0d149973c5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbb7455d2d244b18be0ac9ccfe3474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:09Z,use_quota=True,user_id='43a0fc63ce3745e39e3a39d164e3823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a47dc8-0d16-4da9-ac77-76ecfe4eddd8),volume_type_id=e9a47dc8-0d16-4da9-ac77-76ecfe4eddd8)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d1e68c-fbf7-4dfa-9a9a-b08e1dab7b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d1e68c-fbf7-4dfa-9a9a-b08e1dab7b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62205c71-ebdf-4cf4-be2d-bfa7abd44b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62205c71-ebdf-4cf4-be2d-bfa7abd44b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292f14dd-9ef1-4b06-9682-0d149973c5d1', 'volume_name': 'volume-292f14dd-9ef1-4b06-9682-0d149973c5d1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b1dd50-8d65-4d62-9f2e-61b146150f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b1dd50-8d65-4d62-9f2e-61b146150f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfc3b9a-0834-4fd3-ad85-766108baa8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Volume 292f14dd-9ef1-4b06-9682-0d149973c5d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292f14dd-9ef1-4b06-9682-0d149973c5d1', 'volume_size': 1} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:10 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 1G" returned: 0 in 1.314s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:10 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 Jul 09 16:33:10 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:11 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:11 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 is being set with open permissions: ugo+rw Jul 09 16:33:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:11 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 Jul 09 16:33:11 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:12 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.327s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1ec853b-aa13-4f6b-a845-3bf95690161e,created_at=2026-07-09T14:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1077331786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1ec853b-aa13-4f6b-a845-3bf95690161e,host='devstack@QuobyteHD#QuobyteHD',id=292f14dd-9ef1-4b06-9682-0d149973c5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbb7455d2d244b18be0ac9ccfe3474e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:09Z,use_quota=True,user_id='43a0fc63ce3745e39e3a39d164e3823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a47dc8-0d16-4da9-ac77-76ecfe4eddd8),volume_type_id=e9a47dc8-0d16-4da9-ac77-76ecfe4eddd8)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Creating volume 292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:33:12 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:33:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:12 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 1073741824 Jul 09 16:33:12 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-580c4e1d-33cb-4143-b6e1-6264ca462f45 tempest-SnapshotsActionsTest-274007028 None] Create snapshot completed successfully Jul 09 16:33:13 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 1073741824" returned: 0 in 0.935s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:13 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 Jul 09 16:33:13 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-b0606738-6573-448e-89fd-b99f66dbf948-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-b0606738-6573-448e-89fd-b99f66dbf948-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Acquiring lock "cinder-quobyte-b0606738-6573-448e-89fd-b99f66dbf948" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-b0606738-6573-448e-89fd-b99f66dbf948" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Deleting offline snapshot b0606738-6573-448e-89fd-b99f66dbf948 of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] snapshot_file for this snap is: volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e67e64-785c-4370-af52-fa847c7049ca]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:13 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 Jul 09 16:33:13 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:13 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1" returned: 0 in 0.705s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfc3b9a-0834-4fd3-ad85-766108baa8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292f14dd-9ef1-4b06-9682-0d149973c5d1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e2eb8c-de44-40aa-89ff-95362d5841c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Volume volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 (292f14dd-9ef1-4b06-9682-0d149973c5d1): created successfully Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e2eb8c-de44-40aa-89ff-95362d5841c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Flow 'volume_create_manager' (29cf4271-69fb-4b8b-afe7-599701d1e31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c0768f53-37a5-457b-a8e5-acf0ce92c5bc tempest-GroupSnapshotsV319Test-884635 None] Created volume successfully. Jul 09 16:33:14 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948" returned: 0 in 0.851s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94976ea-56cf-4861-88b6-45c112a7f8e4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:14 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:33:14 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:15 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 1.171s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:15 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 Jul 09 16:33:15 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] GroupSnapshot c2d521b4-78b8-4bca-8720-ca887fd3d4e4: creating. Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Group snapshot c2d521b4-78b8-4bca-8720-ca887fd3d4e4: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Creating offline snapshot 4c090609-e410-4b9a-bdad-9931d1178966 of volume 292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[04adeaa4-4055-4461-b9c7-c7956ab83131]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:15 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 Jul 09 16:33:15 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:16 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948" returned: 0 in 0.858s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:16 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948 Jul 09 16:33:16 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:16 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1" returned: 0 in 0.859s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:16 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 1G Jul 09 16:33:16 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:17 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.b0606738-6573-448e-89fd-b99f66dbf948" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-b0606738-6573-448e-89fd-b99f66dbf948" released by "_delete_snapshot" :: held 3.877s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" released by "delete_snapshot" :: held 3.906s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:17 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Created reservations ['41d45ab0-86c6-45ed-99e1-446974d97c35', '89bd833d-2daf-4c20-a77c-fb3ac88c0d4c', '94794c4b-79bd-4d8f-b0dd-4925724c6e6b', 'c8ac0df8-4ccd-4600-94d3-38f39858b267'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Delete snapshot completed successfully. Jul 09 16:33:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-538b846b-84e9-41c0-8bf1-20524e03bc0f tempest-SnapshotsActionsTest-494542952 None] Lock "cinder-b0606738-6573-448e-89fd-b99f66dbf948-delete_snapshot" released by "delete_snapshot" :: held 4.048s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:17 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 1G" returned: 0 in 0.896s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:17 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 Jul 09 16:33:17 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "cinder-75ad5101-8b3f-41d2-83d6-ef13a63427af-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-75ad5101-8b3f-41d2-83d6-ef13a63427af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "cinder-quobyte-75ad5101-8b3f-41d2-83d6-ef13a63427af" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-quobyte-75ad5101-8b3f-41d2-83d6-ef13a63427af" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Deleting offline snapshot 75ad5101-8b3f-41d2-83d6-ef13a63427af of volume 7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] snapshot_file for this snap is: volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7cd645-0ac3-401c-a334-c264454e6d46]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:18 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:33:18 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:18 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966" returned: 0 in 1.033s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:18 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:33:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:18 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 Jul 09 16:33:18 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:19 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758ce98-9d14-4b22-82eb-768ee48ee638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d7c6e-5d23-4faa-9158-98ecd9ac9bf9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:19 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966" returned: 0 in 0.699s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:19 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 Jul 09 16:33:19 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:19 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.info Jul 09 16:33:19 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:20 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:20 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:33:20 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:20 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.info" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:20 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:33:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:20 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.info Jul 09 16:33:20 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:20 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.info" returned: 0 in 0.780s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.146s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:20 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.994s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9bb2180e-264c-444b-b99f-7476b57b211a tempest-GroupSnapshotsV319Test-884635 None] group_snapshot c2d521b4-78b8-4bca-8720-ca887fd3d4e4: created successfully Jul 09 16:33:21 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af Jul 09 16:33:21 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:21 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638.75ad5101-8b3f-41d2-83d6-ef13a63427af" returned: 0 in 0.706s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-quobyte-75ad5101-8b3f-41d2-83d6-ef13a63427af" released by "_delete_snapshot" :: held 3.575s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" released by "delete_snapshot" :: held 3.605s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:21 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Created reservations ['e4cd3006-efda-45c2-b066-c75760d29ef1', '8026c2c9-fe00-4d80-8f97-f1f94786425d', '1ff73c7d-2371-4964-a1ec-d33dc93fd9a3', 'bf981964-f6c2-415d-b331-d639ea3d9f76'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Delete snapshot completed successfully. Jul 09 16:33:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6457f85b-671f-4e2c-8e57-11350cf395d1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-75ad5101-8b3f-41d2-83d6-ef13a63427af-delete_snapshot" released by "delete_snapshot" :: held 3.852s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "cinder-7758ce98-9d14-4b22-82eb-768ee48ee638-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-7758ce98-9d14-4b22-82eb-768ee48ee638-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] group_snapshot c2d521b4-78b8-4bca-8720-ca887fd3d4e4: deleting Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] group_snapshot c2d521b4-78b8-4bca-8720-ca887fd3d4e4: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Acquiring lock "cinder-quobyte-292f14dd-9ef1-4b06-9682-0d149973c5d1" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Lock "cinder-quobyte-292f14dd-9ef1-4b06-9682-0d149973c5d1" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Acquiring lock "cinder-quobyte-4c090609-e410-4b9a-bdad-9931d1178966" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[67234fa4-c703-4a00-8328-e07450aa5b0c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Lock "cinder-quobyte-4c090609-e410-4b9a-bdad-9931d1178966" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Deleting offline snapshot 4c090609-e410-4b9a-bdad-9931d1178966 of volume 292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] snapshot_file for this snap is: volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5e6daf-6155-4d74-a48b-a4728e505da5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:23 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 Jul 09 16:33:23 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:23 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 Jul 09 16:33:23 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:23 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638" returned: 0 in 0.878s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:23 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966" returned: 0 in 0.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-292f14dd-9ef1-4b06-9682-0d149973c5d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:23 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638 Jul 09 16:33:23 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9c0295-7fbc-497d-a56b-40dc5127c860]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:23 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 Jul 09 16:33:23 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:24 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7758ce98-9d14-4b22-82eb-768ee48ee638" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-quobyte-7758ce98-9d14-4b22-82eb-768ee48ee638" released by "delete_volume" :: held 1.683s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=86,cinder:SELECT=72,cinder:INSERT=17,cinder:DELETE=8 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Created reservations ['e6f1dc4c-491b-479c-8117-97b920df06de', 'dfccb7b4-07ee-4566-aeb5-6ca83329e7cc', '45281025-7a80-4029-bff1-40abeb429cc2', '14af0fa6-7618-4f17-bc2a-5f97abae15ce'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:24 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:33:24 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:24 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:24 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 Jul 09 16:33:24 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:25 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:33:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Deleted volume successfully. Jul 09 16:33:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3f93a9b8-b1ca-4960-9e3b-02f3d5acddb1 tempest-SnapshotsActionsTest-274007028 None] Lock "cinder-7758ce98-9d14-4b22-82eb-768ee48ee638-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:25 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:25 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966 Jul 09 16:33:25 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:26 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1.4c090609-e410-4b9a-bdad-9931d1178966" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Lock "cinder-quobyte-4c090609-e410-4b9a-bdad-9931d1178966" released by "_delete_snapshot" :: held 3.364s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Lock "cinder-quobyte-292f14dd-9ef1-4b06-9682-0d149973c5d1" released by "delete_snapshot" :: held 3.417s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:26 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=93,cinder:UPDATE=98,cinder:DELETE=7,cinder:INSERT=31 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:33:26 devstack cinder-volume[87204]: WARNING cinder.quota [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2116225416 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2116225416, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:33:26 devstack cinder-volume[87204]: WARNING cinder.quota [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2116225416 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2116225416, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:33:26 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] Created reservations ['69b20ffe-c9b0-4882-b841-9837c783e33a', '558f1273-eac1-4b0a-8647-d885e7ec8bdb', 'cd60e86c-3af5-4a7e-b8eb-0826942de024', '19eac691-0db8-4249-82fb-f0e3e1785fab'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-72fc39c3-70b6-4318-a841-8e446147adfe tempest-GroupSnapshotsV319Test-884635 None] group_snapshot c2d521b4-78b8-4bca-8720-ca887fd3d4e4: deleted successfully Jul 09 16:33:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Acquiring lock "cinder-quobyte-292f14dd-9ef1-4b06-9682-0d149973c5d1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Lock "cinder-quobyte-292f14dd-9ef1-4b06-9682-0d149973c5d1" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f447c99e-db8a-4f44-88a6-0a41f274868e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:27 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 Jul 09 16:33:27 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:28 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1" returned: 0 in 1.010s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:28 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1 Jul 09 16:33:28 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:28 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:33:28 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:29 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-292f14dd-9ef1-4b06-9682-0d149973c5d1" returned: 0 in 0.914s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:29 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Lock "cinder-quobyte-292f14dd-9ef1-4b06-9682-0d149973c5d1" released by "delete_volume" :: held 2.017s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Created reservations ['62b95a74-82ce-4d86-a649-8a1ecd0c1b5e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:29 devstack cinder-volume[87204]: WARNING cinder.quota [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2116225416 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2116225416, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Created reservations ['ed35cd15-800f-4d7d-bbee-9460ea315e63', '689fb505-177c-4d87-ac36-191794d45db8', '51844f13-eb6a-4376-ae78-12a354971d21', '12ea0618-f716-4552-832b-94fd9ec8d825'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:29 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:33:29 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:30 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.705s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:30 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:33:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0a1ba557-cf89-4c2f-a00e-4e277f2fa596 tempest-GroupSnapshotsV319Test-884635 None] Delete group completed successfully. Jul 09 16:33:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-8774032b-6464-421b-a7a2-d0c018d62f46 req-699e2168-63cc-4538-9c6e-f0e0ac89fa3a tempest-ServerActionsTestOtherA-151165605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-8774032b-6464-421b-a7a2-d0c018d62f46 req-699e2168-63cc-4538-9c6e-f0e0ac89fa3a tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb739b4d-c719-4137-8f94-2d338c0e49f4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-8774032b-6464-421b-a7a2-d0c018d62f46 req-699e2168-63cc-4538-9c6e-f0e0ac89fa3a tempest-ServerActionsTestOtherA-151165605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:31 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 Jul 09 16:33:31 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:32 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-8774032b-6464-421b-a7a2-d0c018d62f46 req-699e2168-63cc-4538-9c6e-f0e0ac89fa3a tempest-ServerActionsTestOtherA-151165605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2" returned: 0 in 0.900s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-8774032b-6464-421b-a7a2-d0c018d62f46 req-699e2168-63cc-4538-9c6e-f0e0ac89fa3a tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.925s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-8774032b-6464-421b-a7a2-d0c018d62f46 req-699e2168-63cc-4538-9c6e-f0e0ac89fa3a tempest-ServerActionsTestOtherA-151165605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-70a656f7-ef3f-4034-801c-48ebd93b09a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3198c18-36b7-46a5-b033-81cbbb132ea5', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:33:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-8774032b-6464-421b-a7a2-d0c018d62f46 req-699e2168-63cc-4538-9c6e-f0e0ac89fa3a tempest-ServerActionsTestOtherA-151165605 None] attachment_update completed successfully. Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Flow 'volume_create_manager' (ea4baa06-6a7d-4831-bf46-591898134d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f595d1-477c-4d65-9ba6-8093779c2182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f595d1-477c-4d65-9ba6-8093779c2182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1212100054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00456a5-8b07-4f25-83a4-906b13195142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8078ce0992b48149911c6251fc595af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:41Z,use_quota=True,user_id='191a812f617840d3b5c8a4656134c8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b40c91-98a7-4e72-b114-4bc63a645e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b40c91-98a7-4e72-b114-4bc63a645e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9bff5e-5d71-4baf-818d-1bc3adb8ab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9bff5e-5d71-4baf-818d-1bc3adb8ab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00456a5-8b07-4f25-83a4-906b13195142', 'volume_name': 'volume-a00456a5-8b07-4f25-83a4-906b13195142', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3591c167-50de-461c-85d5-134cbc9a2427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3591c167-50de-461c-85d5-134cbc9a2427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaf3684-107a-4be5-95bd-170bcad191b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Volume a00456a5-8b07-4f25-83a4-906b13195142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00456a5-8b07-4f25-83a4-906b13195142', 'volume_size': 1} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1212100054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00456a5-8b07-4f25-83a4-906b13195142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8078ce0992b48149911c6251fc595af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:41Z,use_quota=True,user_id='191a812f617840d3b5c8a4656134c8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Creating volume a00456a5-8b07-4f25-83a4-906b13195142 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:33:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:41 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 1073741824 Jul 09 16:33:41 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-2db25a36-86aa-464f-b976-d268aa914337 tempest-ServerActionsTestOtherA-151165605 None] Terminate volume connection completed successfully. Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-2db25a36-86aa-464f-b976-d268aa914337 tempest-ServerActionsTestOtherA-151165605 None] Deleting attachment b3198c18-36b7-46a5-b033-81cbbb132ea5. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Flow 'volume_create_manager' (44b3fa25-a66a-435c-8eb2-e865a25c8b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3084ef6-3c05-47ed-a1b0-3ca800b404aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3084ef6-3c05-47ed-a1b0-3ca800b404aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1300176683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006b7fb2-18cd-481b-9bad-c0f33fed98ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747dcba459b74f5d8622a6e98af26454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:42Z,use_quota=True,user_id='a393a3fcdbac4088aaa1066cc529622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc77069f-39e0-45bd-a050-2a210f583f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc77069f-39e0-45bd-a050-2a210f583f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917005a-4988-4d9a-a6d8-59166156c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1917005a-4988-4d9a-a6d8-59166156c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006b7fb2-18cd-481b-9bad-c0f33fed98ad', 'volume_name': 'volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5270e9-3a33-41a7-b2bb-c8518be10ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5270e9-3a33-41a7-b2bb-c8518be10ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b258e2-2972-4eb2-8e86-b17afec27035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Volume 006b7fb2-18cd-481b-9bad-c0f33fed98ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad', 'volume_size': 1} Jul 09 16:33:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c4b4c670-d516-4f85-ab4a-7ab6557ba77c tempest-GroupsV314Test-131892916 None] Group tempest-GroupsV314Test-Group-1381486006: creating Jul 09 16:33:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c4b4c670-d516-4f85-ab4a-7ab6557ba77c tempest-GroupsV314Test-131892916 None] Group tempest-GroupsV314Test-Group-1381486006: created successfully Jul 09 16:33:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c4b4c670-d516-4f85-ab4a-7ab6557ba77c tempest-GroupsV314Test-131892916 None] Create group completed successfully. Jul 09 16:33:42 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 1073741824" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:42 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 Jul 09 16:33:42 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:43 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1300176683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006b7fb2-18cd-481b-9bad-c0f33fed98ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747dcba459b74f5d8622a6e98af26454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:42Z,use_quota=True,user_id='a393a3fcdbac4088aaa1066cc529622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Creating volume 006b7fb2-18cd-481b-9bad-c0f33fed98ad {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:33:43 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:43 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad 1073741824 Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaf3684-107a-4be5-95bd-170bcad191b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00456a5-8b07-4f25-83a4-906b13195142', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:43 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f151f5-d731-4976-808e-bb045e7d2bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Volume volume-a00456a5-8b07-4f25-83a4-906b13195142 (a00456a5-8b07-4f25-83a4-906b13195142): created successfully Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f151f5-d731-4976-808e-bb045e7d2bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Flow 'volume_create_manager' (ea4baa06-6a7d-4831-bf46-591898134d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d6214b25-6800-44de-b80d-9331d39074e1 tempest-VolumesServicesTestJSON-1718317340 None] Created volume successfully. Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Flow 'volume_create_manager' (08123139-e3de-44d1-b357-bc534fa88403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56ec794-11e9-4c6a-a356-7a4fea2307b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56ec794-11e9-4c6a-a356-7a4fea2307b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1235119769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3420231a-2e32-47c1-9ffc-f8d58409b652,host='devstack@QuobyteHD#QuobyteHD',id=a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e54e84df22472a8e96373d45a61b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:44Z,use_quota=True,user_id='295a656ab62c448abcc52b1bff45b280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a01f4e3e-a32f-40f3-bda7-28b1acb532ca),volume_type_id=a01f4e3e-a32f-40f3-bda7-28b1acb532ca)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcea4455-434c-4ae8-a46d-183c7896484a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcea4455-434c-4ae8-a46d-183c7896484a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4c0c5f-7714-4c41-9ab2-1fc0bd26ea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4c0c5f-7714-4c41-9ab2-1fc0bd26ea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732', 'volume_name': 'volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b456770a-6878-46d4-ab1f-2bf596c4e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b456770a-6878-46d4-ab1f-2bf596c4e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7a52ba-c08d-4c40-b673-3d3e85f51341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Volume a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732', 'volume_size': 1} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-e1e97216-5b3e-4394-a41b-1a7262323fdb tempest-ServerActionsTestOtherA-151165605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:44 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad 1073741824" returned: 0 in 0.947s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:44 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad Jul 09 16:33:44 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Acquiring lock "cinder-a00456a5-8b07-4f25-83a4-906b13195142-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Lock "cinder-a00456a5-8b07-4f25-83a4-906b13195142-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Acquiring lock "cinder-quobyte-a00456a5-8b07-4f25-83a4-906b13195142" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Lock "cinder-quobyte-a00456a5-8b07-4f25-83a4-906b13195142" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[49728d07-9e52-472b-af9f-12d63c7a41f8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:44 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 Jul 09 16:33:44 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:44 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad" returned: 0 in 0.697s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3420231a-2e32-47c1-9ffc-f8d58409b652,created_at=2026-07-09T14:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1235119769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3420231a-2e32-47c1-9ffc-f8d58409b652,host='devstack@QuobyteHD#QuobyteHD',id=a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e54e84df22472a8e96373d45a61b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:44Z,use_quota=True,user_id='295a656ab62c448abcc52b1bff45b280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a01f4e3e-a32f-40f3-bda7-28b1acb532ca),volume_type_id=a01f4e3e-a32f-40f3-bda7-28b1acb532ca)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Creating volume a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:33:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:44 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 1073741824 Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b258e2-2972-4eb2-8e86-b17afec27035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:44 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978e22d-6348-4345-8019-6696b13d8346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Volume volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad (006b7fb2-18cd-481b-9bad-c0f33fed98ad): created successfully Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978e22d-6348-4345-8019-6696b13d8346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Flow 'volume_create_manager' (44b3fa25-a66a-435c-8eb2-e865a25c8b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-89ce56c8-d647-4fa8-8cb8-a9b2ccce001b tempest-AttachVolumeNegativeTest-1472508837 None] Created volume successfully. Jul 09 16:33:45 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:45 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142 Jul 09 16:33:45 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:45 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 1073741824" returned: 0 in 0.901s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:45 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 Jul 09 16:33:45 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:46 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a00456a5-8b07-4f25-83a4-906b13195142" returned: 0 in 0.688s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Lock "cinder-quobyte-a00456a5-8b07-4f25-83a4-906b13195142" released by "delete_volume" :: held 1.526s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Created reservations ['b9bc930d-a230-436c-8f92-8d3278951d61', 'd34a2b3d-1417-4544-a2de-b4307dfe7d35', '57657162-05b7-4d61-99c2-e768d1c8745c', 'c4d8515d-04aa-43ca-a284-82a7541cb3e7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:46 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:33:46 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:46 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" returned: 0 in 0.656s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-e1e97216-5b3e-4394-a41b-1a7262323fdb tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.443s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7a52ba-c08d-4c40-b673-3d3e85f51341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a487b-c7ed-4ff9-9bd7-2c48fddf7a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd28e3fd-f7bf-45a0-9de5-377cf1acb821]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-e1e97216-5b3e-4394-a41b-1a7262323fdb tempest-ServerActionsTestOtherA-151165605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Volume volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 (a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732): created successfully Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a487b-c7ed-4ff9-9bd7-2c48fddf7a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Flow 'volume_create_manager' (08123139-e3de-44d1-b357-bc534fa88403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0bfbee28-8d50-4a36-bde7-54f65c6fda91 tempest-GroupsV314Test-131892916 None] Created volume successfully. Jul 09 16:33:46 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 Jul 09 16:33:46 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:46 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:33:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Deleted volume successfully. Jul 09 16:33:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7fc4e068-29e6-40a4-a67b-be73e7c322f9 tempest-VolumesServicesTestJSON-1718317340 None] Lock "cinder-a00456a5-8b07-4f25-83a4-906b13195142-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:33:47 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-e1e97216-5b3e-4394-a41b-1a7262323fdb tempest-ServerActionsTestOtherA-151165605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-e1e97216-5b3e-4394-a41b-1a7262323fdb tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-e1e97216-5b3e-4394-a41b-1a7262323fdb tempest-ServerActionsTestOtherA-151165605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-70a656f7-ef3f-4034-801c-48ebd93b09a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74adf212-13e6-402e-bafa-b309ec94b217', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:33:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-97f47b4c-c3ae-47bc-a812-e7ddf17fddb2 req-e1e97216-5b3e-4394-a41b-1a7262323fdb tempest-ServerActionsTestOtherA-151165605 None] attachment_update completed successfully. Jul 09 16:33:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Cloning volume a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 to volume 3b4200ff-5986-43e5-8c7f-37d9e35ad256 Jul 09 16:33:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Creating offline snapshot 8693e6a1-bf01-4e02-88b2-4d8810dec99c of volume a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:33:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7adfd00-f6ba-44c2-8cb4-251398d534bb]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:48 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 Jul 09 16:33:48 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-3177f721-6d97-4322-b169-052958c039d2 req-a1868660-61a4-40b3-8d57-1e6b2faf6f00 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:49 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" returned: 0 in 0.910s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:49 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c 1G Jul 09 16:33:49 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:50 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c 1G" returned: 0 in 0.879s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:50 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c Jul 09 16:33:50 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:51 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c" returned: 0 in 0.938s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:51 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:33:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:51 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c Jul 09 16:33:51 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:52 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:52 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.info Jul 09 16:33:52 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Flow 'volume_create_manager' (021b115e-407b-43f5-868b-9b139ebb7358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1d956d-48f8-49df-9a2d-38ff910cc1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1d956d-48f8-49df-9a2d-38ff910cc1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1458413705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cff9cb-8a56-4247-99ff-0d92dab60926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1038c32dc4db6b7b486b9ed11daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:53Z,use_quota=True,user_id='b64501d7abe94230a9fcf96c0068beba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131c673c-83ac-47af-8944-a1289d3ed08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131c673c-83ac-47af-8944-a1289d3ed08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139a1c5a-e902-41ed-af47-138ced29e1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139a1c5a-e902-41ed-af47-138ced29e1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44cff9cb-8a56-4247-99ff-0d92dab60926', 'volume_name': 'volume-44cff9cb-8a56-4247-99ff-0d92dab60926', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b76bc4-58f6-430c-b7db-f04d473d0b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b76bc4-58f6-430c-b7db-f04d473d0b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f38409-2042-4b1d-882a-305a6848b718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:33:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Volume 44cff9cb-8a56-4247-99ff-0d92dab60926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44cff9cb-8a56-4247-99ff-0d92dab60926', 'volume_size': 1} Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:52 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.info" returned: 0 in 0.701s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:52 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:33:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:52 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.info Jul 09 16:33:52 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:53 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.info" returned: 0 in 0.671s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Acquiring lock "cinder-quobyte-3b4200ff-5986-43e5-8c7f-37d9e35ad256" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-3b4200ff-5986-43e5-8c7f-37d9e35ad256" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] snapshot: 8693e6a1-bf01-4e02-88b2-4d8810dec99c, volume: 3b4200ff-5986-43e5-8c7f-37d9e35ad256, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd839b7e-d64e-453c-a2c6-d88110229772]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:53 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c Jul 09 16:33:53 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:54 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:33:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:33:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:33:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e548d04-9d37-42b7-b3fc-22707476316b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:33:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:54 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 Jul 09 16:33:54 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:33:55 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Jul 09 16:33:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" returned: 0 in 0.813s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:33:55 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:33:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:33:55 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 Jul 09 16:33:55 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:01 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256" returned: 0 in 6.197s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a619a286-0d0d-4569-9130-432b38c626ce]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:01 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 Jul 09 16:34:01 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:02 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:02 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:34:02 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Converted 1024.00 MB image at 165.20 MB/s Jul 09 16:34:02 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:34:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:02 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 Jul 09 16:34:02 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:02 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=44,cinder:INSERT=9,cinder:UPDATE=41,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:34:02 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=42,cinder:SELECT=49,cinder:DELETE=1,cinder:INSERT=9 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:34:03 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256" returned: 0 in 0.626s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-3b4200ff-5986-43e5-8c7f-37d9e35ad256" released by "_copy_volume_from_snapshot" :: held 9.425s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Acquiring lock "cinder-quobyte-8693e6a1-bf01-4e02-88b2-4d8810dec99c" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-8693e6a1-bf01-4e02-88b2-4d8810dec99c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Deleting offline snapshot 8693e6a1-bf01-4e02-88b2-4d8810dec99c of volume a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] snapshot_file for this snap is: volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[96211a5d-750b-445b-9f4c-9ef85ffc2991]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:03 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c Jul 09 16:34:03 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:03 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c" returned: 0 in 0.761s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a4390-fadd-4565-99dc-05d23790187e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:04 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 Jul 09 16:34:04 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:04 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" returned: 0 in 0.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:04 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c Jul 09 16:34:04 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:05 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:05 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c Jul 09 16:34:05 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:06 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732.8693e6a1-bf01-4e02-88b2-4d8810dec99c" returned: 0 in 0.649s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-8693e6a1-bf01-4e02-88b2-4d8810dec99c" released by "_delete_snapshot" :: held 2.998s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.576s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-3177f721-6d97-4322-b169-052958c039d2 req-a1868660-61a4-40b3-8d57-1e6b2faf6f00 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.254s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1def00ac-be7e-492c-ad5c-eeffae6f26e7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-3177f721-6d97-4322-b169-052958c039d2 req-a1868660-61a4-40b3-8d57-1e6b2faf6f00 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bc8ea050-0044-4bb4-b62a-1a559c4ed81d tempest-GroupsV314Test-131892916 None] Create group from source-group-3420231a-2e32-47c1-9ffc-f8d58409b652 completed successfully. Jul 09 16:34:06 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad Jul 09 16:34:06 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Acquiring lock "cinder-quobyte-3b4200ff-5986-43e5-8c7f-37d9e35ad256" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-3b4200ff-5986-43e5-8c7f-37d9e35ad256" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[24130689-d37c-4304-9b16-53d91f04e2ca]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:07 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 Jul 09 16:34:07 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:07 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-3177f721-6d97-4322-b169-052958c039d2 req-a1868660-61a4-40b3-8d57-1e6b2faf6f00 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad" returned: 0 in 0.913s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-3177f721-6d97-4322-b169-052958c039d2 req-a1868660-61a4-40b3-8d57-1e6b2faf6f00 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.338s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1458413705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cff9cb-8a56-4247-99ff-0d92dab60926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1038c32dc4db6b7b486b9ed11daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:33:53Z,use_quota=True,user_id='b64501d7abe94230a9fcf96c0068beba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Creating volume 44cff9cb-8a56-4247-99ff-0d92dab60926 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:34:07 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:07 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 1073741824 Jul 09 16:34:07 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-3177f721-6d97-4322-b169-052958c039d2 req-a1868660-61a4-40b3-8d57-1e6b2faf6f00 tempest-AttachVolumeNegativeTest-1472508837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '509a53a3-5408-48b4-90e6-2e2cc57f1075', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:34:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-3177f721-6d97-4322-b169-052958c039d2 req-a1868660-61a4-40b3-8d57-1e6b2faf6f00 tempest-AttachVolumeNegativeTest-1472508837 None] attachment_update completed successfully. Jul 09 16:34:07 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:07 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256 Jul 09 16:34:07 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:07 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 1073741824" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:08 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 Jul 09 16:34:08 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:08 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3b4200ff-5986-43e5-8c7f-37d9e35ad256" returned: 0 in 0.712s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-3b4200ff-5986-43e5-8c7f-37d9e35ad256" released by "delete_volume" :: held 1.590s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Created reservations ['cdcda57f-4021-4afb-bc09-04d51cd05d08'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:08 devstack cinder-volume[87204]: WARNING cinder.quota [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-824103889 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-824103889, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:34:08 devstack cinder-volume[87204]: WARNING cinder.quota [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-824103889 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-824103889, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Created reservations ['b5a6956a-b98c-451d-8b39-70012539930d', 'c727eb09-ef03-49b2-8db1-b1d504333e70', '801808a2-389d-4f4c-b64e-906962f59356', '19e1a634-a2b3-4610-8e8c-48c3116785bc'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:08 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f38409-2042-4b1d-882a-305a6848b718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44cff9cb-8a56-4247-99ff-0d92dab60926', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22674b4-ae92-4bde-9d00-5cc5b446597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Volume volume-44cff9cb-8a56-4247-99ff-0d92dab60926 (44cff9cb-8a56-4247-99ff-0d92dab60926): created successfully Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22674b4-ae92-4bde-9d00-5cc5b446597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Flow 'volume_create_manager' (021b115e-407b-43f5-868b-9b139ebb7358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a4371db0-45be-4cd3-a350-c2a8e9f255c5 tempest-VolumesListAdminTestJSON-1002634267 None] Created volume successfully. Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:08 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:08 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:09 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.637s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7ca1bd3a-ace4-43e1-88d9-96156574084f tempest-GroupsV314Test-131892916 None] Delete group completed successfully. Jul 09 16:34:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Acquiring lock "cinder-quobyte-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5fabd5-e136-459f-a338-94bda9639722]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:09 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 Jul 09 16:34:09 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Flow 'volume_create_manager' (b79caedc-043c-49c7-865d-53cf4a73b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df9b05b-2f2a-4bce-a13c-42fd3eb5e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df9b05b-2f2a-4bce-a13c-42fd3eb5e212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1647439533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1038c32dc4db6b7b486b9ed11daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:10Z,use_quota=True,user_id='b64501d7abe94230a9fcf96c0068beba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e06c2c7-8686-4cb6-80c1-c90242ffb8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e06c2c7-8686-4cb6-80c1-c90242ffb8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c39d38c-2c4b-40f6-8b3c-8925e72035ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c39d38c-2c4b-40f6-8b3c-8925e72035ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73', 'volume_name': 'volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6052a583-d83d-4fff-a251-53a404fc492d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6052a583-d83d-4fff-a251-53a404fc492d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08437369-4a1b-4b91-b636-9722a9516394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Volume ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73', 'volume_size': 1} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1647439533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1038c32dc4db6b7b486b9ed11daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:10Z,use_quota=True,user_id='b64501d7abe94230a9fcf96c0068beba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Creating volume ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:34:10 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:10 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 1073741824 Jul 09 16:34:10 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:10 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:10 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732 Jul 09 16:34:10 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:11 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Lock "cinder-quobyte-a8f8f6f7-d5bc-4e10-9cfc-e471dccd8732" released by "delete_volume" :: held 1.741s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Created reservations ['db31fcc6-ee20-4921-b613-fd71959ddfcd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:11 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 1073741824" returned: 0 in 1.093s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Created reservations ['76a9bd38-308c-4cfb-8c05-8184fb9d5fd9', 'a98be33d-3a1d-4138-a2ab-416f58439954', 'ad942f31-ec74-4497-abfb-e42f16a1f7c2', '092eddc5-7641-4ff4-aaf5-7cdbd15c2ebf'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:11 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 Jul 09 16:34:11 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:11 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:11 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:12 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:12 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fe0f46b9-7ca4-42f5-b2d9-92f57d290ff0 tempest-GroupsV314Test-131892916 None] Delete group completed successfully. Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08437369-4a1b-4b91-b636-9722a9516394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4461c6f-909d-42c8-b98b-ea7cba924a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Volume volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 (ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73): created successfully Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4461c6f-909d-42c8-b98b-ea7cba924a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Flow 'volume_create_manager' (b79caedc-043c-49c7-865d-53cf4a73b79d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-032791b6-97c1-4832-9825-d60ffc930315 tempest-VolumesListAdminTestJSON-1002634267 None] Created volume successfully. Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Flow 'volume_create_manager' (29866ce2-b3aa-4d67-ab52-d3a44967ac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4092880c-9928-4f35-bfe8-0c2fac313fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4092880c-9928-4f35-bfe8-0c2fac313fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1890362603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0437ab-5612-43b5-a72d-1a717eb03007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1038c32dc4db6b7b486b9ed11daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:14Z,use_quota=True,user_id='b64501d7abe94230a9fcf96c0068beba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35aa131-2bd0-4417-9d4e-803dc5764ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35aa131-2bd0-4417-9d4e-803dc5764ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b46ea7-f032-4ee5-a7f8-c33a6ab8b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b46ea7-f032-4ee5-a7f8-c33a6ab8b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0437ab-5612-43b5-a72d-1a717eb03007', 'volume_name': 'volume-8e0437ab-5612-43b5-a72d-1a717eb03007', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeac58e-1b22-4253-a4d3-7c72b7bf8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeac58e-1b22-4253-a4d3-7c72b7bf8555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd89cdf6-127e-4fb9-a2ac-17d12afe9e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Volume 8e0437ab-5612-43b5-a72d-1a717eb03007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0437ab-5612-43b5-a72d-1a717eb03007', 'volume_size': 1} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1890362603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0437ab-5612-43b5-a72d-1a717eb03007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1038c32dc4db6b7b486b9ed11daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:14Z,use_quota=True,user_id='b64501d7abe94230a9fcf96c0068beba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Creating volume 8e0437ab-5612-43b5-a72d-1a717eb03007 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:34:14 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:34:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:14 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 1073741824 Jul 09 16:34:14 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:15 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 1073741824" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:15 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 Jul 09 16:34:15 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:16 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007" returned: 0 in 0.688s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:34:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd89cdf6-127e-4fb9-a2ac-17d12afe9e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0437ab-5612-43b5-a72d-1a717eb03007', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb4097-8e54-4f50-8854-fb0e0f7af05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:16 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Volume volume-8e0437ab-5612-43b5-a72d-1a717eb03007 (8e0437ab-5612-43b5-a72d-1a717eb03007): created successfully Jul 09 16:34:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb4097-8e54-4f50-8854-fb0e0f7af05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Flow 'volume_create_manager' (29866ce2-b3aa-4d67-ab52-d3a44967ac84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4780e39b-be93-4451-89d3-6f18b03723fb tempest-VolumesListAdminTestJSON-1002634267 None] Created volume successfully. Jul 09 16:34:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bfdf15e7-ebd8-4048-8d30-4273992a24b9 tempest-GroupsV320Test-427960205 None] Group tempest-GroupsV320Test-Group-1282674351: creating Jul 09 16:34:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bfdf15e7-ebd8-4048-8d30-4273992a24b9 tempest-GroupsV320Test-427960205 None] Group tempest-GroupsV320Test-Group-1282674351: created successfully Jul 09 16:34:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bfdf15e7-ebd8-4048-8d30-4273992a24b9 tempest-GroupsV320Test-427960205 None] Create group completed successfully. Jul 09 16:34:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-e0b4d884-29c6-48a7-b856-cef92089b9a0 req-33db9fba-68cf-43bf-b5d1-452bc5faa3fc tempest-ServerActionsTestOtherA-151165605 None] Terminate volume connection completed successfully. Jul 09 16:34:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-e0b4d884-29c6-48a7-b856-cef92089b9a0 req-33db9fba-68cf-43bf-b5d1-452bc5faa3fc tempest-ServerActionsTestOtherA-151165605 None] Deleting attachment 74adf212-13e6-402e-bafa-b309ec94b217. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Flow 'volume_create_manager' (fccdd9d2-d043-4425-b668-deef35343178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d21d315-a40c-436f-95ef-041409b4113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d21d315-a40c-436f-95ef-041409b4113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33150ccf-c4dd-4508-8241-c2742004079b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec68d7f19b854e8fa3f1924f67441d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:19Z,use_quota=True,user_id='67f64b7864bf4f1896bebec139481316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b43f594-3292-47e6-b3c5-c4878f305ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b43f594-3292-47e6-b3c5-c4878f305ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd6c982-a36f-4a61-bcb2-222cb3c74f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd6c982-a36f-4a61-bcb2-222cb3c74f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33150ccf-c4dd-4508-8241-c2742004079b', 'volume_name': 'volume-33150ccf-c4dd-4508-8241-c2742004079b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37021d4-1d6e-48c9-829b-55eec0db773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37021d4-1d6e-48c9-829b-55eec0db773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a46dc33-5f07-4ef2-aef6-e711cb6a60c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Volume 33150ccf-c4dd-4508-8241-c2742004079b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33150ccf-c4dd-4508-8241-c2742004079b', 'volume_size': 1} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33150ccf-c4dd-4508-8241-c2742004079b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec68d7f19b854e8fa3f1924f67441d22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:19Z,use_quota=True,user_id='67f64b7864bf4f1896bebec139481316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Creating volume 33150ccf-c4dd-4508-8241-c2742004079b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:34:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:19 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b 1073741824 Jul 09 16:34:19 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Created reservations ['86bc1306-4b19-4a85-8ab5-58b95b844a27'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:19 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:19 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:20 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b 1073741824" returned: 0 in 0.975s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:20 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b Jul 09 16:34:20 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:20 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.808s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:20 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f27a4964-eac6-4157-bb37-188cce8ba194 tempest-GroupsV320Test-427960205 None] Delete group completed successfully. Jul 09 16:34:21 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:34:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a46dc33-5f07-4ef2-aef6-e711cb6a60c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33150ccf-c4dd-4508-8241-c2742004079b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ba572c-f63e-4ad1-ba72-e018bea51894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Volume volume-33150ccf-c4dd-4508-8241-c2742004079b (33150ccf-c4dd-4508-8241-c2742004079b): created successfully Jul 09 16:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ba572c-f63e-4ad1-ba72-e018bea51894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Flow 'volume_create_manager' (fccdd9d2-d043-4425-b668-deef35343178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f7b0992a-1bbf-41cf-8fda-0bcf589d15ff tempest-VolumesListAdminTestJSON-57647165 None] Created volume successfully. Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Acquiring lock "cinder-33150ccf-c4dd-4508-8241-c2742004079b-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Lock "cinder-33150ccf-c4dd-4508-8241-c2742004079b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Acquiring lock "cinder-quobyte-33150ccf-c4dd-4508-8241-c2742004079b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Lock "cinder-quobyte-33150ccf-c4dd-4508-8241-c2742004079b" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f4f0e5-3162-4616-aa83-7d60f15a6dd7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "cinder-8e0437ab-5612-43b5-a72d-1a717eb03007-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-8e0437ab-5612-43b5-a72d-1a717eb03007-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "cinder-quobyte-8e0437ab-5612-43b5-a72d-1a717eb03007" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:22 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b Jul 09 16:34:22 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-quobyte-8e0437ab-5612-43b5-a72d-1a717eb03007" acquired by "delete_volume" :: waited 0.049s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8e544-b6bd-44e6-a0a2-e0155db39a8f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:23 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 Jul 09 16:34:23 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:23 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b" returned: 0 in 1.230s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:24 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b Jul 09 16:34:24 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:24 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007" returned: 0 in 1.055s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:24 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007 Jul 09 16:34:24 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:24 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33150ccf-c4dd-4508-8241-c2742004079b" returned: 0 in 0.857s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Lock "cinder-quobyte-33150ccf-c4dd-4508-8241-c2742004079b" released by "delete_volume" :: held 2.173s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Created reservations ['f91ca5a9-cdad-4477-aa67-58088f12f2e0', '22a60483-5ac7-4059-8a2e-b12ae282a1e4', '2e2dd28a-aedf-4c96-b9ce-08b3a7f3c8d5', '83ca59a3-3a4b-4966-99c2-1c69fc6fd63f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:25 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8e0437ab-5612-43b5-a72d-1a717eb03007" returned: 0 in 1.093s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:25 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:25 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-quobyte-8e0437ab-5612-43b5-a72d-1a717eb03007" released by "delete_volume" :: held 2.202s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Created reservations ['f2d3a056-f5c7-4f32-a31c-97ecb6cbfda4', '921dd93e-56f4-434e-8314-651d96e7a8cc', 'e16158d0-e0d8-478b-9674-21e7bf6ee9a0', '8186501f-cecc-48d4-8488-4745e2f5e06e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:25 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:25 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:26 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.872s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Deleted volume successfully. Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7274aa19-3ee6-4e23-bdb1-1f78ebae886d tempest-VolumesListAdminTestJSON-57647165 None] Lock "cinder-33150ccf-c4dd-4508-8241-c2742004079b-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:26 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Deleted volume successfully. Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f6f80c7d-db73-470c-bcdb-b25ad3cdc4b3 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-8e0437ab-5612-43b5-a72d-1a717eb03007-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "cinder-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "cinder-quobyte-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-quobyte-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb959e-7e55-4894-ad27-7b67d491fa32]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:26 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 Jul 09 16:34:26 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:27 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73" returned: 0 in 1.143s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:27 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73 Jul 09 16:34:27 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:28 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73" returned: 0 in 0.658s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-quobyte-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73" released by "delete_volume" :: held 1.846s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Created reservations ['c05e918c-d87a-43f8-bea1-f519ad84fdea', '1afdc7cc-4221-4ed8-b3f7-c1229a300bca', '20302b9e-0448-4af3-a14e-8d8ca8d06828', 'e867384b-7f2c-4920-9226-13966032440f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:28 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:28 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "cinder-44cff9cb-8a56-4247-99ff-0d92dab60926-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-44cff9cb-8a56-4247-99ff-0d92dab60926-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "cinder-quobyte-44cff9cb-8a56-4247-99ff-0d92dab60926" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-quobyte-44cff9cb-8a56-4247-99ff-0d92dab60926" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d0bdbf-73d3-4b41-a7bb-2c98e29b851a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:29 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 Jul 09 16:34:29 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:29 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.314s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Deleted volume successfully. Jul 09 16:34:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8e9af1d-ea1b-473a-8758-d6710d21fa73 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-ed1f3cb1-9f6b-4e16-8b4d-ba3e399ddf73-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:30 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926" returned: 0 in 1.329s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:30 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926 Jul 09 16:34:30 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:31 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-44cff9cb-8a56-4247-99ff-0d92dab60926" returned: 0 in 1.131s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-quobyte-44cff9cb-8a56-4247-99ff-0d92dab60926" released by "delete_volume" :: held 2.561s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Acquiring lock "cinder-70a656f7-ef3f-4034-801c-48ebd93b09a2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Created reservations ['9af9d94d-ae5b-451e-bd4f-b8a0163092e6', 'f3daf9ef-0c38-4693-acd5-1c9e1c567909', 'a03397e3-64d1-4490-a7b9-0cf5ee2026dd', 'e1ba5bac-4273-4147-a2e1-61a8736f9561'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Lock "cinder-70a656f7-ef3f-4034-801c-48ebd93b09a2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Acquiring lock "cinder-quobyte-70a656f7-ef3f-4034-801c-48ebd93b09a2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Lock "cinder-quobyte-70a656f7-ef3f-4034-801c-48ebd93b09a2" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e640a9-7b23-4e7e-8a01-70a7292a7610]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:31 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:31 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:32 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 Jul 09 16:34:32 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:32 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.044s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Deleted volume successfully. Jul 09 16:34:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-43aa6624-86ac-4584-8d14-f90ca53feb95 tempest-VolumesListAdminTestJSON-1002634267 None] Lock "cinder-44cff9cb-8a56-4247-99ff-0d92dab60926-delete_volume" released by "delete_volume" :: held 4.073s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:33 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2" returned: 0 in 1.660s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:33 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2 Jul 09 16:34:33 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:34 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-70a656f7-ef3f-4034-801c-48ebd93b09a2" returned: 0 in 1.109s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Lock "cinder-quobyte-70a656f7-ef3f-4034-801c-48ebd93b09a2" released by "delete_volume" :: held 2.905s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Created reservations ['a59d94e6-2415-46b1-b44b-d26058a1c3a3', '3ed39512-74bd-4b43-874d-19e7356c3de5', '4e087f40-c582-48b5-9e59-8968ffa118f7', '3b9609d8-d99a-44fa-96d3-18fde0b25ee0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:35 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:35 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:36 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.075s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Deleted volume successfully. Jul 09 16:34:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dbdcff34-2ce6-46c6-bb0f-9f9127349dd8 tempest-ServerActionsTestOtherA-151165605 None] Lock "cinder-70a656f7-ef3f-4034-801c-48ebd93b09a2-delete_volume" released by "delete_volume" :: held 4.424s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Flow 'volume_create_manager' (f9fe6ce3-3fa0-4a8b-a82d-5f7332e3219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebec6ff5-b598-4ec6-b8ed-12fd3bc928a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebec6ff5-b598-4ec6-b8ed-12fd3bc928a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1636748078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a5d504-d532-4791-a8e1-3659a0779344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc234bdc1ca4c0b859026d1bd1adecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:43Z,use_quota=True,user_id='55bd3811ff5d4f698619050c85bfaf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556715ea-af47-4935-8678-d22853032b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556715ea-af47-4935-8678-d22853032b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f1136f-1441-484f-a704-7ee9ead4ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f1136f-1441-484f-a704-7ee9ead4ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a5d504-d532-4791-a8e1-3659a0779344', 'volume_name': 'volume-72a5d504-d532-4791-a8e1-3659a0779344', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460e12f8-04ef-4af0-ae67-d4811529984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460e12f8-04ef-4af0-ae67-d4811529984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05406087-631c-4b8c-8494-4dcfd1c05f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Volume 72a5d504-d532-4791-a8e1-3659a0779344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a5d504-d532-4791-a8e1-3659a0779344', 'volume_size': 1} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1636748078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a5d504-d532-4791-a8e1-3659a0779344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cc234bdc1ca4c0b859026d1bd1adecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:43Z,use_quota=True,user_id='55bd3811ff5d4f698619050c85bfaf68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Creating volume 72a5d504-d532-4791-a8e1-3659a0779344 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:34:43 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:34:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:43 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 1073741824 Jul 09 16:34:43 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:44 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 1073741824" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:44 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 Jul 09 16:34:44 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:44 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344" returned: 0 in 0.692s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:34:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05406087-631c-4b8c-8494-4dcfd1c05f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a5d504-d532-4791-a8e1-3659a0779344', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd286544-e8e7-4b77-a355-99257aad7428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Volume volume-72a5d504-d532-4791-a8e1-3659a0779344 (72a5d504-d532-4791-a8e1-3659a0779344): created successfully Jul 09 16:34:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd286544-e8e7-4b77-a355-99257aad7428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Flow 'volume_create_manager' (f9fe6ce3-3fa0-4a8b-a82d-5f7332e3219e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-acd2627f-9878-48d0-bc84-e933794f9cde tempest-VolumesMetadataTest-1838477640 None] Created volume successfully. Jul 09 16:34:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Acquiring lock "cinder-72a5d504-d532-4791-a8e1-3659a0779344-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Lock "cinder-72a5d504-d532-4791-a8e1-3659a0779344-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Acquiring lock "cinder-quobyte-72a5d504-d532-4791-a8e1-3659a0779344" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Lock "cinder-quobyte-72a5d504-d532-4791-a8e1-3659a0779344" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[019b4334-486d-4507-bf9d-744f9031fcf5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:46 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 Jul 09 16:34:46 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:46 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:47 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344 Jul 09 16:34:47 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:47 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-72a5d504-d532-4791-a8e1-3659a0779344" returned: 0 in 0.809s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Lock "cinder-quobyte-72a5d504-d532-4791-a8e1-3659a0779344" released by "delete_volume" :: held 1.646s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Created reservations ['c9504588-b52a-4102-8d07-4a3a84bb3e7c', '0dbf1169-caea-44b7-8d43-1ccc0660a435', 'f7dd3d2e-13b1-4b62-9a75-3a21e44c1994', 'fe4ae2f0-92c2-4d39-aa8b-345c44c396b2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:47 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:34:47 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:48 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.774s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:48 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:34:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Deleted volume successfully. Jul 09 16:34:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-723c159b-32d8-4e72-a956-74f94a34f1fa tempest-VolumesMetadataTest-1838477640 None] Lock "cinder-72a5d504-d532-4791-a8e1-3659a0779344-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Flow 'volume_create_manager' (999af3d4-d644-40b9-a63b-6c496acb7a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d77ed99-4fa1-44f0-8d64-4b1e5c76b69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d77ed99-4fa1-44f0-8d64-4b1e5c76b69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1558178285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77122d8-208c-44ba-a863-925f76fab9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ce033ed78412f9a896202c42e1f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:54Z,use_quota=True,user_id='bc75d85264f6480db921eb2b25196b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c66db4c-5611-431b-b62d-1812f826bcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c66db4c-5611-431b-b62d-1812f826bcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23c09f0-5fce-48ac-954c-cbc5b58142e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23c09f0-5fce-48ac-954c-cbc5b58142e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77122d8-208c-44ba-a863-925f76fab9aa', 'volume_name': 'volume-a77122d8-208c-44ba-a863-925f76fab9aa', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f5ab07-f1cd-4025-8627-ec6da6b20ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f5ab07-f1cd-4025-8627-ec6da6b20ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d18d216-23dd-421f-ad4e-199c446bbe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Volume a77122d8-208c-44ba-a863-925f76fab9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77122d8-208c-44ba-a863-925f76fab9aa', 'volume_size': 1} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1558178285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77122d8-208c-44ba-a863-925f76fab9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ce033ed78412f9a896202c42e1f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:34:54Z,use_quota=True,user_id='bc75d85264f6480db921eb2b25196b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Creating volume a77122d8-208c-44ba-a863-925f76fab9aa {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:34:54 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:34:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:54 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa 1073741824 Jul 09 16:34:54 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:55 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa 1073741824" returned: 0 in 1.172s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:34:55 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa Jul 09 16:34:55 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:34:56 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Jul 09 16:34:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:34:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:34:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:34:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d18d216-23dd-421f-ad4e-199c446bbe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77122d8-208c-44ba-a863-925f76fab9aa', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3e4550-ade7-4591-a054-9b4fd52bb922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:34:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Volume volume-a77122d8-208c-44ba-a863-925f76fab9aa (a77122d8-208c-44ba-a863-925f76fab9aa): created successfully Jul 09 16:34:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3e4550-ade7-4591-a054-9b4fd52bb922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:34:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Flow 'volume_create_manager' (999af3d4-d644-40b9-a63b-6c496acb7a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:34:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0df89b94-122c-496a-a6c0-8544b7b90abe tempest-VolumesTransfersV357Test-2018052304 None] Created volume successfully. Jul 09 16:34:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6b14ced4-982b-4345-a7c2-d5aaba0125a3 tempest-VolumesTransfersV357Test-1918627912 None] Transfer volume completed successfully. Jul 09 16:34:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Acquiring lock "cinder-a77122d8-208c-44ba-a863-925f76fab9aa-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-a77122d8-208c-44ba-a863-925f76fab9aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Acquiring lock "cinder-quobyte-a77122d8-208c-44ba-a863-925f76fab9aa" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:34:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-quobyte-a77122d8-208c-44ba-a863-925f76fab9aa" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:34:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe706fe-8860-4666-b34b-ecafcf7a0612]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:34:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:00 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa Jul 09 16:35:00 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:00 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa" returned: 0 in 1.079s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:01 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa Jul 09 16:35:01 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:01 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a77122d8-208c-44ba-a863-925f76fab9aa" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-quobyte-a77122d8-208c-44ba-a863-925f76fab9aa" released by "delete_volume" :: held 1.999s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Created reservations ['fcc7229e-12f9-4cb5-8cb5-1f7bb3b45c21', '94d59e2b-3274-4f81-8099-a11a57c93d1c', 'b8cf671d-bfd9-4837-b87d-8655d0c6ad5d', '4979860c-1d1d-4ea4-baf3-a4fc6b6d7504'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:02 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:35:02 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=108,cinder:SELECT=75,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:35:02 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=99,cinder:SELECT=79,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:35:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Deleted volume successfully. Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Flow 'volume_create_manager' (b41fdc68-a841-4d84-baed-0a0dcd834d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e321755f-0388-4fe7-ad0d-6d07f9472d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e321755f-0388-4fe7-ad0d-6d07f9472d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1387985337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1740404e-1f4d-4243-bf12-44588ec7314d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ce033ed78412f9a896202c42e1f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:03Z,use_quota=True,user_id='bc75d85264f6480db921eb2b25196b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434b5b24-57be-486b-a0e8-4b764bdbc04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434b5b24-57be-486b-a0e8-4b764bdbc04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fae91a-c059-4576-a093-28c56cee9c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fae91a-c059-4576-a093-28c56cee9c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1740404e-1f4d-4243-bf12-44588ec7314d', 'volume_name': 'volume-1740404e-1f4d-4243-bf12-44588ec7314d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3f3d4d-07a2-4568-bfc9-3608d581d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3f3d4d-07a2-4568-bfc9-3608d581d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8d271a-0ae0-41bd-8247-e7692d9348cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Volume 1740404e-1f4d-4243-bf12-44588ec7314d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1740404e-1f4d-4243-bf12-44588ec7314d', 'volume_size': 1} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1387985337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1740404e-1f4d-4243-bf12-44588ec7314d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ce033ed78412f9a896202c42e1f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:03Z,use_quota=True,user_id='bc75d85264f6480db921eb2b25196b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Creating volume 1740404e-1f4d-4243-bf12-44588ec7314d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:35:03 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e75aef11-3275-40c4-b2ea-fd26a475abb0 tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-a77122d8-208c-44ba-a863-925f76fab9aa-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:03 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d 1073741824 Jul 09 16:35:03 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:04 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d 1073741824" returned: 0 in 1.045s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:04 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d Jul 09 16:35:04 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:04 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8d271a-0ae0-41bd-8247-e7692d9348cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1740404e-1f4d-4243-bf12-44588ec7314d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc4165e-4711-49da-9cbe-ac6f8e512a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Volume volume-1740404e-1f4d-4243-bf12-44588ec7314d (1740404e-1f4d-4243-bf12-44588ec7314d): created successfully Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc4165e-4711-49da-9cbe-ac6f8e512a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Flow 'volume_create_manager' (b41fdc68-a841-4d84-baed-0a0dcd834d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ccb60396-3eca-4df3-9078-92e741ff0768 tempest-VolumesTransfersV357Test-2018052304 None] Created volume successfully. Jul 09 16:35:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Acquiring lock "cinder-1740404e-1f4d-4243-bf12-44588ec7314d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-1740404e-1f4d-4243-bf12-44588ec7314d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Acquiring lock "cinder-quobyte-1740404e-1f4d-4243-bf12-44588ec7314d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-quobyte-1740404e-1f4d-4243-bf12-44588ec7314d" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a89c5-b61b-4333-92d9-159a906659c2]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:35:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:06 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d Jul 09 16:35:06 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:07 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d" returned: 0 in 0.927s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:07 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d Jul 09 16:35:07 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-c4e40d5a-451d-4824-9fdc-fc2f176812d5 req-2c3180ec-de4f-4f43-b167-4d1f7855d57e tempest-AttachVolumeNegativeTest-1472508837 None] Terminate volume connection completed successfully. Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-c4e40d5a-451d-4824-9fdc-fc2f176812d5 req-2c3180ec-de4f-4f43-b167-4d1f7855d57e tempest-AttachVolumeNegativeTest-1472508837 None] Deleting attachment 509a53a3-5408-48b4-90e6-2e2cc57f1075. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:35:08 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1740404e-1f4d-4243-bf12-44588ec7314d" returned: 0 in 0.899s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-quobyte-1740404e-1f4d-4243-bf12-44588ec7314d" released by "delete_volume" :: held 1.902s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Created reservations ['5514d9ad-f817-4c2b-b98b-76aa09052037', '825b4eb9-6a7b-41ae-8a08-a374d5a30d38', '7f56c0ae-dc48-4d18-ac16-a0e4067e9d7b', 'b1aad78e-2935-4d1e-8b4f-5a2fa9e8ed42'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:08 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:35:08 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:09 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.004s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:35:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Deleted volume successfully. Jul 09 16:35:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-912a45ad-311b-4177-b5d6-483e204d7e5b tempest-VolumesTransfersV357Test-137553284 None] Lock "cinder-1740404e-1f4d-4243-bf12-44588ec7314d-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:18 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:DELETE=1,cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:35:19 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:35:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:35:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:35:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:35:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:28 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:35:28 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:29 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:35:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:35:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:35:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (48135d38-39a9-4e0c-a907-dfc94f97dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d49c316-4e7d-4940-b96a-0fe81d893dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d49c316-4e7d-4940-b96a-0fe81d893dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2038995608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431b3f5b-0938-43eb-9ef1-78995c838174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:32Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7162ad67-dba0-455f-8d37-318f721276c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7162ad67-dba0-455f-8d37-318f721276c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb05926a-4630-422d-b6cc-3ddda1b859bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb05926a-4630-422d-b6cc-3ddda1b859bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431b3f5b-0938-43eb-9ef1-78995c838174', 'volume_name': 'volume-431b3f5b-0938-43eb-9ef1-78995c838174', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00df6573-2aa0-44d3-a463-2fdc7bd6b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00df6573-2aa0-44d3-a463-2fdc7bd6b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb351d59-6281-4b0d-aaae-02875f2da349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume 431b3f5b-0938-43eb-9ef1-78995c838174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431b3f5b-0938-43eb-9ef1-78995c838174', 'volume_size': 1} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2038995608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431b3f5b-0938-43eb-9ef1-78995c838174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:32Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Creating volume 431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:35:31 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:35:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:32 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 1073741824 Jul 09 16:35:32 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:33 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 1073741824" returned: 0 in 1.517s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:33 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 Jul 09 16:35:33 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:34 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174" returned: 0 in 1.225s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] <== create_volume: return (2874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:35:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.878s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb351d59-6281-4b0d-aaae-02875f2da349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431b3f5b-0938-43eb-9ef1-78995c838174', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66478c9-f0e0-47dd-a788-596cdd655ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume volume-431b3f5b-0938-43eb-9ef1-78995c838174 (431b3f5b-0938-43eb-9ef1-78995c838174): created successfully Jul 09 16:35:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66478c9-f0e0-47dd-a788-596cdd655ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (48135d38-39a9-4e0c-a907-dfc94f97dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d9f57cb8-5958-4168-bdb4-8354c0609f76 tempest-VolumesSnapshotTestJSON-2022295786 None] Created volume successfully. Jul 09 16:35:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Creating offline snapshot 163788c6-7106-499e-aee9-6a0c42920c5e of volume 431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:35:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e959942-2ea7-4858-aa03-6f426812f052]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:35:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:36 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 Jul 09 16:35:36 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:37 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174" returned: 0 in 0.773s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:37 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e 1G Jul 09 16:35:37 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:37 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e 1G" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431b3f5b-0938-43eb-9ef1-78995c838174 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:37 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431b3f5b-0938-43eb-9ef1-78995c838174 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e Jul 09 16:35:37 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:38 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431b3f5b-0938-43eb-9ef1-78995c838174 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e" returned: 0 in 0.750s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:38 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e is being set with open permissions: ugo+rw Jul 09 16:35:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:38 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e Jul 09 16:35:38 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:39 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:39 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.info Jul 09 16:35:39 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:40 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.info" returned: 0 in 0.915s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:40 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.info is being set with open permissions: ugo+rw Jul 09 16:35:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:40 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.info Jul 09 16:35:40 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:41 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.info" returned: 0 in 1.186s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.294s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-70971745-2d94-49e9-b3ab-26cdcd5c95ae tempest-VolumesSnapshotTestJSON-2022295786 None] Create snapshot completed successfully Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-163788c6-7106-499e-aee9-6a0c42920c5e-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-163788c6-7106-499e-aee9-6a0c42920c5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-431b3f5b-0938-43eb-9ef1-78995c838174" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-431b3f5b-0938-43eb-9ef1-78995c838174" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-163788c6-7106-499e-aee9-6a0c42920c5e" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-163788c6-7106-499e-aee9-6a0c42920c5e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Deleting offline snapshot 163788c6-7106-499e-aee9-6a0c42920c5e of volume 431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] snapshot_file for this snap is: volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae9865e-7cb3-499e-9f77-d670152690f7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:35:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:42 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e Jul 09 16:35:42 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:43 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431b3f5b-0938-43eb-9ef1-78995c838174(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:35:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a46dbe-73d7-4a07-9005-db18ddfd0980]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:35:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:43 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 Jul 09 16:35:43 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:44 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174" returned: 0 in 0.860s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:44 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e Jul 09 16:35:44 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:45 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e" returned: 0 in 1.147s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:45 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e Jul 09 16:35:45 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:46 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174.163788c6-7106-499e-aee9-6a0c42920c5e" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-163788c6-7106-499e-aee9-6a0c42920c5e" released by "_delete_snapshot" :: held 3.805s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-431b3f5b-0938-43eb-9ef1-78995c838174" released by "delete_snapshot" :: held 3.836s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['f8ba0984-35e5-47cf-a030-9fb1f1c55799', 'd5487c11-0e24-4413-8115-056dd8a74c9d', '1e817ab6-670f-4ad2-8d93-018b0fc3dcc6', 'baa348cd-e734-4820-a2d1-afe848b9a385'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:35:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Delete snapshot completed successfully. Jul 09 16:35:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d095b907-4d72-4c48-ad03-c3e5fc66fc6d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-163788c6-7106-499e-aee9-6a0c42920c5e-delete_snapshot" released by "delete_snapshot" :: held 4.031s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (161f25e6-4734-47d1-8f1f-ab5845c4c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52196a7-d720-4724-9f53-6697330c9ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52196a7-d720-4724-9f53-6697330c9ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1424866593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7893640-8324-4abb-acf0-03edff8b01e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:48Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f1456e-1f3e-4935-b160-52f82d3dd6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f1456e-1f3e-4935-b160-52f82d3dd6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d17bf7f-ddd6-4b3f-8af5-e19f4cf9adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d17bf7f-ddd6-4b3f-8af5-e19f4cf9adcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7893640-8324-4abb-acf0-03edff8b01e7', 'volume_name': 'volume-a7893640-8324-4abb-acf0-03edff8b01e7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b00d41c-ba2b-46c1-8ccf-34442aa5d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b00d41c-ba2b-46c1-8ccf-34442aa5d653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06413d23-377e-481a-aa94-3118181e3bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Volume a7893640-8324-4abb-acf0-03edff8b01e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7893640-8324-4abb-acf0-03edff8b01e7', 'volume_size': 1} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1424866593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7893640-8324-4abb-acf0-03edff8b01e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:48Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Creating volume a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:35:47 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:35:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:47 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 1073741824 Jul 09 16:35:47 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:49 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 1073741824" returned: 0 in 1.872s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:49 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 Jul 09 16:35:49 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:50 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7" returned: 0 in 1.333s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] <== create_volume: return (3304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:35:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.312s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06413d23-377e-481a-aa94-3118181e3bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7893640-8324-4abb-acf0-03edff8b01e7', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c10219-35a5-41a9-976c-2229a9b82fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Volume volume-a7893640-8324-4abb-acf0-03edff8b01e7 (a7893640-8324-4abb-acf0-03edff8b01e7): created successfully Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c10219-35a5-41a9-976c-2229a9b82fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (161f25e6-4734-47d1-8f1f-ab5845c4c378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-24ba2e99-58a6-4675-8f0a-d2737ae4213e tempest-VolumesSnapshotTestJSON-2022295786 None] Created volume successfully. Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (2c051d39-75fc-4a94-be8b-b38060c2ee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d86edb-b918-486f-8fe1-815aeb8c1e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d86edb-b918-486f-8fe1-815aeb8c1e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768069842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc31684-ebf1-4cb1-9051-364a91da60ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:52Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4ea059-82f4-461b-a183-0708a56c681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4ea059-82f4-461b-a183-0708a56c681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f100eb8-1fd5-4033-855b-41c589c2c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f100eb8-1fd5-4033-855b-41c589c2c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc31684-ebf1-4cb1-9051-364a91da60ae', 'volume_name': 'volume-0fc31684-ebf1-4cb1-9051-364a91da60ae', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f68308-3aff-4a32-898b-15b965d67b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f68308-3aff-4a32-898b-15b965d67b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0467b3-326a-43bc-8124-2f530db128b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Volume 0fc31684-ebf1-4cb1-9051-364a91da60ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc31684-ebf1-4cb1-9051-364a91da60ae', 'volume_size': 1} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768069842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc31684-ebf1-4cb1-9051-364a91da60ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:35:52Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Creating volume 0fc31684-ebf1-4cb1-9051-364a91da60ae {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:35:51 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:35:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:51 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae 1073741824 Jul 09 16:35:51 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:35:53 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae 1073741824" returned: 0 in 1.660s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:53 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae Jul 09 16:35:53 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:54 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae" returned: 0 in 0.903s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] <== create_volume: return (2625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.631s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.555s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0467b3-326a-43bc-8124-2f530db128b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc31684-ebf1-4cb1-9051-364a91da60ae', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57496b94-afdf-424c-9f77-57d0182b8777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Creating offline snapshot 56c955d3-7fe5-4d18-92ea-2c1f1c54575f of volume a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:35:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Volume volume-0fc31684-ebf1-4cb1-9051-364a91da60ae (0fc31684-ebf1-4cb1-9051-364a91da60ae): created successfully Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57496b94-afdf-424c-9f77-57d0182b8777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (2c051d39-75fc-4a94-be8b-b38060c2ee75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31c69c0-1b75-4d3b-972f-fbe6733fa04c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f2a9caa8-5475-4d3f-85c3-82f8b149b768 tempest-VolumesActionsTest-840040933 None] Created volume successfully. Jul 09 16:35:54 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 Jul 09 16:35:54 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c9078a73-72e7-462d-b38f-96eb366fcda6 tempest-VolumesActionsTest-840040933 None] Acquiring lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae" by "attach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c9078a73-72e7-462d-b38f-96eb366fcda6 tempest-VolumesActionsTest-840040933 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae" acquired by "attach_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c9078a73-72e7-462d-b38f-96eb366fcda6 tempest-VolumesActionsTest-840040933 None] Attaching volume 0fc31684-ebf1-4cb1-9051-364a91da60ae to instance 3313753b-6ae5-4c40-b0b0-4c04e0b337f3 at mountpoint /dev/vdb on host None. Jul 09 16:35:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c9078a73-72e7-462d-b38f-96eb366fcda6 tempest-VolumesActionsTest-840040933 None] Attach volume completed successfully. Jul 09 16:35:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c9078a73-72e7-462d-b38f-96eb366fcda6 tempest-VolumesActionsTest-840040933 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae" released by "attach_volume" :: held 0.251s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:56 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7" returned: 0 in 2.005s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:56 devstack sudo[92321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f 1G Jul 09 16:35:56 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fd3393b2-ec3c-4f82-a857-d5f6131a84cb tempest-VolumesActionsTest-458002956 None] Terminate volume connection completed successfully. Jul 09 16:35:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd3393b2-ec3c-4f82-a857-d5f6131a84cb tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd3393b2-ec3c-4f82-a857-d5f6131a84cb tempest-VolumesActionsTest-458002956 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fd3393b2-ec3c-4f82-a857-d5f6131a84cb tempest-VolumesActionsTest-458002956 None] Detaching volume 0fc31684-ebf1-4cb1-9051-364a91da60ae from instance 3313753b-6ae5-4c40-b0b0-4c04e0b337f3. Jul 09 16:35:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fd3393b2-ec3c-4f82-a857-d5f6131a84cb tempest-VolumesActionsTest-458002956 None] Detach volume completed successfully. Jul 09 16:35:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd3393b2-ec3c-4f82-a857-d5f6131a84cb tempest-VolumesActionsTest-458002956 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:57 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f 1G" returned: 0 in 1.367s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7893640-8324-4abb-acf0-03edff8b01e7 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:57 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7893640-8324-4abb-acf0-03edff8b01e7 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f Jul 09 16:35:57 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d16cd268-7b02-4aec-a41f-c569b183acb0 tempest-VolumesActionsTest-840040933 None] Acquiring lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d16cd268-7b02-4aec-a41f-c569b183acb0 tempest-VolumesActionsTest-840040933 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d16cd268-7b02-4aec-a41f-c569b183acb0 tempest-VolumesActionsTest-840040933 None] Volume detach called, but volume not attached. Jul 09 16:35:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d16cd268-7b02-4aec-a41f-c569b183acb0 tempest-VolumesActionsTest-840040933 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:35:59 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7893640-8324-4abb-acf0-03edff8b01e7 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f" returned: 0 in 1.207s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:35:59 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f is being set with open permissions: ugo+rw Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:59 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f Jul 09 16:35:59 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Acquiring lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Acquiring lock "cinder-quobyte-0fc31684-ebf1-4cb1-9051-364a91da60ae" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Lock "cinder-quobyte-0fc31684-ebf1-4cb1-9051-364a91da60ae" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d5d484-8ff1-417f-80b0-1aa2ee52541e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:35:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:35:59 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae Jul 09 16:35:59 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:00 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f" returned: 0 in 1.407s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:00 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.info Jul 09 16:36:00 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:00 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae" returned: 0 in 1.306s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:00 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae Jul 09 16:36:00 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:01 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.info" returned: 0 in 1.101s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:01 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.info is being set with open permissions: ugo+rw Jul 09 16:36:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:01 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.info Jul 09 16:36:01 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:01 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0fc31684-ebf1-4cb1-9051-364a91da60ae" returned: 0 in 1.012s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Lock "cinder-quobyte-0fc31684-ebf1-4cb1-9051-364a91da60ae" released by "delete_volume" :: held 2.406s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Created reservations ['f7f86d28-d383-4639-add2-b2c4f8b2fe5e', 'db976fe9-7052-475e-840d-245b26867a2a', 'a4c8065c-c2fc-4045-8ed5-aea914892b08', 'eded2a6a-9b44-4a89-b6b7-7c639bd2489a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:02 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:02 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:02 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.info" returned: 0 in 1.113s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.430s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ece76392-5603-48cc-9a5a-9dcd57c85a48 tempest-VolumesSnapshotTestJSON-2022295786 None] Create snapshot completed successfully Jul 09 16:36:03 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.068s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Deleted volume successfully. Jul 09 16:36:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-252dde1f-240e-4c66-a91b-51933f8cea58 tempest-VolumesActionsTest-840040933 None] Lock "cinder-0fc31684-ebf1-4cb1-9051-364a91da60ae-delete_volume" released by "delete_volume" :: held 3.951s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (2ed07556-0d98-41fc-acb8-aa65f13e1196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47942d95-b480-4b7b-9b88-2979b32e24a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47942d95-b480-4b7b-9b88-2979b32e24a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-731151444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8314db15-f49c-4593-ab35-a2b4000865a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=56c955d3-7fe5-4d18-92ea-2c1f1c54575f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:04Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734ec468-c77e-41a9-92c1-9b7012356fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734ec468-c77e-41a9-92c1-9b7012356fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e97ea3-b5d5-43c4-9dd6-03c2f5b0fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e97ea3-b5d5-43c4-9dd6-03c2f5b0fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8314db15-f49c-4593-ab35-a2b4000865a4', 'volume_name': 'volume-8314db15-f49c-4593-ab35-a2b4000865a4', 'volume_size': 2, 'snapshot_id': '56c955d3-7fe5-4d18-92ea-2c1f1c54575f'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f4f6d-bf2c-4bdd-8f8f-9341c06398d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f4f6d-bf2c-4bdd-8f8f-9341c06398d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f09783d-b0a1-4304-a941-8db9a88aabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume 8314db15-f49c-4593-ab35-a2b4000865a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8314db15-f49c-4593-ab35-a2b4000865a4', 'volume_size': 2, 'snapshot_id': '56c955d3-7fe5-4d18-92ea-2c1f1c54575f'} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-56c955d3-7fe5-4d18-92ea-2c1f1c54575f-8314db15-f49c-4593-ab35-a2b4000865a4" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-56c955d3-7fe5-4d18-92ea-2c1f1c54575f-8314db15-f49c-4593-ab35-a2b4000865a4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Creating volume 8314db15-f49c-4593-ab35-a2b4000865a4 from snapshot 56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-8314db15-f49c-4593-ab35-a2b4000865a4" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-8314db15-f49c-4593-ab35-a2b4000865a4" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] snapshot: 56c955d3-7fe5-4d18-92ea-2c1f1c54575f, volume: 8314db15-f49c-4593-ab35-a2b4000865a4, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[429eabc7-5dca-4b2c-8e10-e41c98b10782]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:04 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f Jul 09 16:36:04 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:05 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f" returned: 0 in 1.237s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7893640-8324-4abb-acf0-03edff8b01e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:36:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:36:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:36:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d18f5-9aef-4047-8a89-9742ccb0324c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:05 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 Jul 09 16:36:05 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Flow 'volume_create_manager' (475eae11-bafb-4ab6-ac1a-ab6f303df551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91722f83-fe9c-4df9-ab0f-c7f9d56e4791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91722f83-fe9c-4df9-ab0f-c7f9d56e4791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316491528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a820aa76-3a95-4f1a-8d37-600df0d915ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6a004545e84cddba9b2fa88c7b0654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:06Z,use_quota=True,user_id='4850c2ae5b944e77bf2aaa3a937b6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32caccd-7374-47e0-8d7c-4c3317981f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32caccd-7374-47e0-8d7c-4c3317981f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6fd0ac-ed4e-4db5-96a2-3185230dd8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6fd0ac-ed4e-4db5-96a2-3185230dd8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a820aa76-3a95-4f1a-8d37-600df0d915ee', 'volume_name': 'volume-a820aa76-3a95-4f1a-8d37-600df0d915ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79258e9a-5f15-4622-beee-9945ad20f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79258e9a-5f15-4622-beee-9945ad20f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be293171-74c2-49a6-931c-ae0304faf08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Volume a820aa76-3a95-4f1a-8d37-600df0d915ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a820aa76-3a95-4f1a-8d37-600df0d915ee', 'volume_size': 1} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:06 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7" returned: 0 in 1.161s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:36:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:06 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 Jul 09 16:36:06 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:11 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4" returned: 0 in 4.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c264b5d3-7783-4318-956b-b2ff2c758a51]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:11 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 Jul 09 16:36:11 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (f62c1ab6-42e1-4287-8af3-7d74bab637f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa468512-9d5a-434c-9c19-826550812aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa468512-9d5a-434c-9c19-826550812aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-190727333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d09028-3b2e-4d50-b151-e17be624ad5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:12Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7d67aa-5bc5-4982-8170-2aeda8a8c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7d67aa-5bc5-4982-8170-2aeda8a8c660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42ec438-4567-48e9-8b0b-1d7c9bc047bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42ec438-4567-48e9-8b0b-1d7c9bc047bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d09028-3b2e-4d50-b151-e17be624ad5a', 'volume_name': 'volume-c6d09028-3b2e-4d50-b151-e17be624ad5a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0320cf-846d-4f00-9862-f68943cc986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0320cf-846d-4f00-9862-f68943cc986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da04fd71-bb97-4768-8fd5-98e8dadef1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Volume c6d09028-3b2e-4d50-b151-e17be624ad5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d09028-3b2e-4d50-b151-e17be624ad5a', 'volume_size': 1} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:12 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7" returned: 0 in 0.968s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:36:12 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Converted 1024.00 MB image at 211.87 MB/s Jul 09 16:36:12 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 is being set with open permissions: ugo+rw Jul 09 16:36:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:12 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 Jul 09 16:36:12 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:13 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4" returned: 0 in 0.662s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-8314db15-f49c-4593-ab35-a2b4000865a4" released by "_copy_volume_from_snapshot" :: held 9.018s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-56c955d3-7fe5-4d18-92ea-2c1f1c54575f-8314db15-f49c-4593-ab35-a2b4000865a4" released by "_create_volume_from_snapshot" :: held 9.062s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.081s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.188s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1316491528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a820aa76-3a95-4f1a-8d37-600df0d915ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6a004545e84cddba9b2fa88c7b0654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:06Z,use_quota=True,user_id='4850c2ae5b944e77bf2aaa3a937b6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Creating volume a820aa76-3a95-4f1a-8d37-600df0d915ee {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:13 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:13 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee 1073741824 Jul 09 16:36:13 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f09783d-b0a1-4304-a941-8db9a88aabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8314db15-f49c-4593-ab35-a2b4000865a4', 'volume_size': 2, 'snapshot_id': '56c955d3-7fe5-4d18-92ea-2c1f1c54575f'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fe363b-acf1-4468-807c-ed64f6a14890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume volume-8314db15-f49c-4593-ab35-a2b4000865a4 (8314db15-f49c-4593-ab35-a2b4000865a4): created successfully Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fe363b-acf1-4468-807c-ed64f6a14890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (2ed07556-0d98-41fc-acb8-aa65f13e1196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e2c13ad1-302e-4d90-b92b-36e6b725a830 tempest-VolumesSnapshotTestJSON-2022295786 None] Created volume successfully. Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-8314db15-f49c-4593-ab35-a2b4000865a4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-8314db15-f49c-4593-ab35-a2b4000865a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-8314db15-f49c-4593-ab35-a2b4000865a4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-8314db15-f49c-4593-ab35-a2b4000865a4" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[654fd48c-3f0e-487c-9968-1fdab8061448]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:14 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee 1073741824" returned: 0 in 0.904s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:14 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 Jul 09 16:36:14 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:14 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee Jul 09 16:36:14 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:14 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4" returned: 0 in 0.780s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:15 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee" returned: 0 in 0.663s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.799s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-190727333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d09028-3b2e-4d50-b151-e17be624ad5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:12Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Creating volume c6d09028-3b2e-4d50-b151-e17be624ad5a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:15 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4 Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:15 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:15 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a 1073741824 Jul 09 16:36:15 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be293171-74c2-49a6-931c-ae0304faf08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a820aa76-3a95-4f1a-8d37-600df0d915ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b4c063-b6f4-4d0d-9ab9-807401714306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Volume volume-a820aa76-3a95-4f1a-8d37-600df0d915ee (a820aa76-3a95-4f1a-8d37-600df0d915ee): created successfully Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b4c063-b6f4-4d0d-9ab9-807401714306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Flow 'volume_create_manager' (475eae11-bafb-4ab6-ac1a-ab6f303df551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3e1a0f00-e481-4c64-b452-ef187c197221 tempest-ServersNegativeTestJSON-390004179 None] Created volume successfully. Jul 09 16:36:15 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8314db15-f49c-4593-ab35-a2b4000865a4" returned: 0 in 0.672s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-8314db15-f49c-4593-ab35-a2b4000865a4" released by "delete_volume" :: held 1.499s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['eb73b708-4806-466c-9f4f-bef5d19ff6d0', 'aa04eeec-f5a6-4b1d-b6ae-42fe74a8d622', 'beef9dd2-61ea-4da0-9d92-24c95ac62843', '11174661-92e5-4f5a-a565-3c9b6ec5ad51'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:15 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:15 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:15 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a 1073741824" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:15 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a Jul 09 16:36:15 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-56c955d3-7fe5-4d18-92ea-2c1f1c54575f-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-56c955d3-7fe5-4d18-92ea-2c1f1c54575f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-a7893640-8324-4abb-acf0-03edff8b01e7" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:16 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-a7893640-8324-4abb-acf0-03edff8b01e7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-56c955d3-7fe5-4d18-92ea-2c1f1c54575f" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Deleted volume successfully. Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-56c955d3-7fe5-4d18-92ea-2c1f1c54575f" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Deleting offline snapshot 56c955d3-7fe5-4d18-92ea-2c1f1c54575f of volume a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] snapshot_file for this snap is: volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe31f0-7ceb-4054-81a6-1f195c204ab8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aa891073-d09e-4469-ba24-db5396b1ff89 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-8314db15-f49c-4593-ab35-a2b4000865a4-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:16 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da04fd71-bb97-4768-8fd5-98e8dadef1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d09028-3b2e-4d50-b151-e17be624ad5a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4358a024-85d5-4640-82a1-4da2ff94efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:16 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Volume volume-c6d09028-3b2e-4d50-b151-e17be624ad5a (c6d09028-3b2e-4d50-b151-e17be624ad5a): created successfully Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4358a024-85d5-4640-82a1-4da2ff94efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:16 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f Jul 09 16:36:16 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (f62c1ab6-42e1-4287-8af3-7d74bab637f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8bfd82c0-a76a-4531-b682-5a73252ab3d1 tempest-VolumesActionsTest-840040933 None] Created volume successfully. Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Flow 'volume_create_manager' (bdff83cb-97d2-4be6-bef4-2d5a4cb3558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574d340e-ff2d-4baa-9a6c-c7e946c9953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574d340e-ff2d-4baa-9a6c-c7e946c9953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-562635909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846a8bbc-ca2e-4280-b77d-156a2744956e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747dcba459b74f5d8622a6e98af26454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:17Z,use_quota=True,user_id='a393a3fcdbac4088aaa1066cc529622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a901f9-ea57-4eb4-b35e-b0a2e87cbcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a901f9-ea57-4eb4-b35e-b0a2e87cbcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d345f215-b8cb-4d39-8874-0ae7d6f1c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d345f215-b8cb-4d39-8874-0ae7d6f1c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846a8bbc-ca2e-4280-b77d-156a2744956e', 'volume_name': 'volume-846a8bbc-ca2e-4280-b77d-156a2744956e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9778ec-26ff-4bf7-8074-03ccd2761b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9778ec-26ff-4bf7-8074-03ccd2761b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da559ac8-6da9-48f0-9881-ed96d4c91523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Volume 846a8bbc-ca2e-4280-b77d-156a2744956e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846a8bbc-ca2e-4280-b77d-156a2744956e', 'volume_size': 1} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-562635909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846a8bbc-ca2e-4280-b77d-156a2744956e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747dcba459b74f5d8622a6e98af26454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:17Z,use_quota=True,user_id='a393a3fcdbac4088aaa1066cc529622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Creating volume 846a8bbc-ca2e-4280-b77d-156a2744956e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:17 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e 1073741824 Jul 09 16:36:17 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Flow 'volume_create_manager' (cd5ee26d-ced9-4d8b-a918-5a77939f4c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f161c167-08e9-4be7-95af-db73b22edc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-c6d09028-3b2e-4d50-b151-e17be624ad5a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:17 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f" returned: 0 in 1.027s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7893640-8324-4abb-acf0-03edff8b01e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Lock "cinder-c6d09028-3b2e-4d50-b151-e17be624ad5a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f161c167-08e9-4be7-95af-db73b22edc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1013843011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3c93ff-8e46-492e-98ab-1f19ae525a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6a004545e84cddba9b2fa88c7b0654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:18Z,use_quota=True,user_id='4850c2ae5b944e77bf2aaa3a937b6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d30bc-d1ab-4737-8ff8-36ac31345e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40d30bc-d1ab-4737-8ff8-36ac31345e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae502373-64bd-46cd-8e0e-a419d344a234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae502373-64bd-46cd-8e0e-a419d344a234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3c93ff-8e46-492e-98ab-1f19ae525a69', 'volume_name': 'volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0aef44-433f-49db-954b-966528b89f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0aef44-433f-49db-954b-966528b89f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52aafff-c2e8-4434-a626-b1f5bfe430be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Volume 5d3c93ff-8e46-492e-98ab-1f19ae525a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69', 'volume_size': 1} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d050b-4f92-42eb-a007-95e6fbd7e0ec]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-quobyte-c6d09028-3b2e-4d50-b151-e17be624ad5a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-c6d09028-3b2e-4d50-b151-e17be624ad5a" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[add40e7c-e2b1-4035-a3b3-c374028e7fe7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:17 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 Jul 09 16:36:17 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:17 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a Jul 09 16:36:17 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:18 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e 1073741824" returned: 0 in 0.922s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:18 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e Jul 09 16:36:18 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:18 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7" returned: 0 in 0.850s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:18 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f Jul 09 16:36:18 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:18 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:18 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a Jul 09 16:36:18 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:18 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e" returned: 0 in 0.684s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1013843011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3c93ff-8e46-492e-98ab-1f19ae525a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6a004545e84cddba9b2fa88c7b0654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:18Z,use_quota=True,user_id='4850c2ae5b944e77bf2aaa3a937b6522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Creating volume 5d3c93ff-8e46-492e-98ab-1f19ae525a69 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:18 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da559ac8-6da9-48f0-9881-ed96d4c91523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846a8bbc-ca2e-4280-b77d-156a2744956e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02108b8-8172-4fbc-9ca4-976967bba63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:18 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 1073741824 Jul 09 16:36:18 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Volume volume-846a8bbc-ca2e-4280-b77d-156a2744956e (846a8bbc-ca2e-4280-b77d-156a2744956e): created successfully Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02108b8-8172-4fbc-9ca4-976967bba63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Flow 'volume_create_manager' (bdff83cb-97d2-4be6-bef4-2d5a4cb3558d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-83a045cb-fc56-47c2-9395-6af98d972cc6 tempest-AttachVolumeNegativeTest-1472508837 None] Created volume successfully. Jul 09 16:36:19 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c6d09028-3b2e-4d50-b151-e17be624ad5a" returned: 0 in 0.714s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-c6d09028-3b2e-4d50-b151-e17be624ad5a" released by "delete_volume" :: held 1.576s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Created reservations ['c9da9886-4003-4262-aa79-5309b9d2f98f', '40c4093a-09c4-4e8e-ae5c-ab71a0423ce2', 'a4d849b4-1bf4-461f-ac19-648cd24c7afb', 'afff1a01-1607-46da-967e-00152f9f7069'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:19 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f" returned: 0 in 0.870s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:19 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f Jul 09 16:36:19 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:19 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:19 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:19 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 1073741824" returned: 0 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=47,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:36:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:19 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 Jul 09 16:36:19 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:20 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7.56c955d3-7fe5-4d18-92ea-2c1f1c54575f" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-56c955d3-7fe5-4d18-92ea-2c1f1c54575f" released by "_delete_snapshot" :: held 3.704s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-a7893640-8324-4abb-acf0-03edff8b01e7" released by "delete_snapshot" :: held 3.757s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:20 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Deleted volume successfully. Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81ced258-a77f-4823-882b-27e8d1a75737 tempest-VolumesActionsTest-458002956 None] Lock "cinder-c6d09028-3b2e-4d50-b151-e17be624ad5a-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['ba0bf4c9-ded2-41a2-a0dd-3884ba5ee090', '569afbac-a27b-4c47-a323-20cbfca7effe', '67e46a85-6431-45e8-8804-14c7009edb5e', '051b5a27-507d-4ae9-9a10-a54f9f3b08b0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Delete snapshot completed successfully. Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-82929bc7-1a33-455c-8f4e-1a1aadde419d tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-56c955d3-7fe5-4d18-92ea-2c1f1c54575f-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (078702be-fae3-4883-9842-a7c4931dc239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abc11aa-c86f-4b3f-ad34-ffe10b8ae844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abc11aa-c86f-4b3f-ad34-ffe10b8ae844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-957662694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bd1a03-9c1b-4580-a1ca-56717b6d59bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:20Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e248f1-6830-46a7-90d5-ba20ee0e027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e248f1-6830-46a7-90d5-ba20ee0e027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145f1da4-f4cc-41f5-9312-14f0fbb18e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145f1da4-f4cc-41f5-9312-14f0fbb18e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bd1a03-9c1b-4580-a1ca-56717b6d59bf', 'volume_name': 'volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1649e68c-9315-42f6-9ff7-35ac6ce9ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1649e68c-9315-42f6-9ff7-35ac6ce9ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c926f93-7c27-43b5-b75a-6cff4c3a44db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Volume d7bd1a03-9c1b-4580-a1ca-56717b6d59bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf', 'volume_size': 1} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:20 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-957662694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bd1a03-9c1b-4580-a1ca-56717b6d59bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:20Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Creating volume d7bd1a03-9c1b-4580-a1ca-56717b6d59bf {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:20 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:20 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf 1073741824 Jul 09 16:36:20 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52aafff-c2e8-4434-a626-b1f5bfe430be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cda57d-adb3-4078-abde-8348ea43cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Volume volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 (5d3c93ff-8e46-492e-98ab-1f19ae525a69): created successfully Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12cda57d-adb3-4078-abde-8348ea43cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Flow 'volume_create_manager' (cd5ee26d-ced9-4d8b-a918-5a77939f4c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8b12f176-31db-4921-8c44-fcb3102c3289 tempest-ServersNegativeTestJSON-390004179 None] Created volume successfully. Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-a7893640-8324-4abb-acf0-03edff8b01e7-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-a7893640-8324-4abb-acf0-03edff8b01e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-a7893640-8324-4abb-acf0-03edff8b01e7" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-a7893640-8324-4abb-acf0-03edff8b01e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[131bfdb2-6e66-4af7-84e9-d40b2e8071f0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:21 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 Jul 09 16:36:21 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:21 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf 1073741824" returned: 0 in 0.903s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:21 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf Jul 09 16:36:21 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:21 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7" returned: 0 in 0.801s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:21 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7 Jul 09 16:36:21 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "cinder-5d3c93ff-8e46-492e-98ab-1f19ae525a69-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-5d3c93ff-8e46-492e-98ab-1f19ae525a69-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "cinder-quobyte-5d3c93ff-8e46-492e-98ab-1f19ae525a69" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-quobyte-5d3c93ff-8e46-492e-98ab-1f19ae525a69" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[18199480-3a1f-4574-9bb5-69821464cb3e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-2b738555-f7e3-4f01-8a7b-77a4b2664c3c req-d4da0a9a-7b6b-4b73-a125-fce163a8dd61 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:22 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf" returned: 0 in 0.778s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-2b738555-f7e3-4f01-8a7b-77a4b2664c3c req-d4da0a9a-7b6b-4b73-a125-fce163a8dd61 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c926f93-7c27-43b5-b75a-6cff4c3a44db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb9badd-8176-4c09-b733-e69aaf555b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[60812462-b99a-4577-9bc0-740ee165f98d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-2b738555-f7e3-4f01-8a7b-77a4b2664c3c req-d4da0a9a-7b6b-4b73-a125-fce163a8dd61 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:22 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Volume volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf (d7bd1a03-9c1b-4580-a1ca-56717b6d59bf): created successfully Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb9badd-8176-4c09-b733-e69aaf555b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (078702be-fae3-4883-9842-a7c4931dc239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:22 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 Jul 09 16:36:22 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-08740fe8-2f46-4ab8-9e37-64866d7ca590 tempest-VolumesActionsTest-840040933 None] Created volume successfully. Jul 09 16:36:22 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a7893640-8324-4abb-acf0-03edff8b01e7" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-a7893640-8324-4abb-acf0-03edff8b01e7" released by "delete_volume" :: held 1.654s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:22 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e Jul 09 16:36:22 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['f478b53a-453b-46e9-95bc-a1ca3b0f40d4', '4a5d1037-cc02-468e-9e46-925637ca32fd', '4b028f89-29ed-440f-8727-1c98a575544c', '851eb6d5-a72c-44a2-a859-e9c517228c78'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:22 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:22 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:23 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69" returned: 0 in 0.857s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:23 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69 Jul 09 16:36:23 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:23 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-2b738555-f7e3-4f01-8a7b-77a4b2664c3c req-d4da0a9a-7b6b-4b73-a125-fce163a8dd61 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e" returned: 0 in 0.874s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-2b738555-f7e3-4f01-8a7b-77a4b2664c3c req-d4da0a9a-7b6b-4b73-a125-fce163a8dd61 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.903s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-2b738555-f7e3-4f01-8a7b-77a4b2664c3c req-d4da0a9a-7b6b-4b73-a125-fce163a8dd61 tempest-AttachVolumeNegativeTest-1472508837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-846a8bbc-ca2e-4280-b77d-156a2744956e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8661d352-b74b-4c3f-8e20-8ac5033bdd2e', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:36:23 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.731s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Deleted volume successfully. Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0425f482-a520-4eda-a58f-b4170aa0f756 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-a7893640-8324-4abb-acf0-03edff8b01e7-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-2b738555-f7e3-4f01-8a7b-77a4b2664c3c req-d4da0a9a-7b6b-4b73-a125-fce163a8dd61 tempest-AttachVolumeNegativeTest-1472508837 None] attachment_update completed successfully. Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (34bb0b92-9e67-4494-acdb-d88a5480e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb56c575-17a6-43a4-9ccb-82569d0a3764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb56c575-17a6-43a4-9ccb-82569d0a3764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109670141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:24Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8a311a-abd8-46ee-ae9b-56cac439d5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8a311a-abd8-46ee-ae9b-56cac439d5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ba0ab-d347-4b96-85d9-435d91cdedd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ba0ab-d347-4b96-85d9-435d91cdedd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501', 'volume_name': 'volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc12b6d-5095-4a65-a785-31e10679c28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc12b6d-5095-4a65-a785-31e10679c28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b638a2c-07ea-4024-bd98-f9a3fd5cfbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Volume e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501', 'volume_size': 1} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2109670141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:24Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Creating volume e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:23 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:23 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 1073741824 Jul 09 16:36:23 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Lock "cinder-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-quobyte-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[26946996-e814-4efa-bf9a-41b912f95639]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:23 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5d3c93ff-8e46-492e-98ab-1f19ae525a69" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-quobyte-5d3c93ff-8e46-492e-98ab-1f19ae525a69" released by "delete_volume" :: held 1.662s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Created reservations ['bd41bbb9-ce3f-458b-a515-79bfe3c9a15b', '3f2f0de2-66c6-4a1a-be2f-7cbbfd958d61', 'b6974022-e3a0-4ca8-9e85-759693cc9b5c', 'df48f4c0-5cca-410f-9be5-b7aa27af6f1b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:24 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf Jul 09 16:36:24 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:24 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:24 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "cinder-a820aa76-3a95-4f1a-8d37-600df0d915ee-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-a820aa76-3a95-4f1a-8d37-600df0d915ee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "cinder-quobyte-a820aa76-3a95-4f1a-8d37-600df0d915ee" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-quobyte-a820aa76-3a95-4f1a-8d37-600df0d915ee" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:24 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[567310b2-2d15-4dc1-843e-d70c6b86469f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:24 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 1073741824" returned: 0 in 1.107s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:24 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf Jul 09 16:36:24 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:24 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee Jul 09 16:36:24 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:25 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 Jul 09 16:36:25 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:25 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.923s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Deleted volume successfully. Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee2d0de6-2380-49a5-abd9-f6149a100547 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-5d3c93ff-8e46-492e-98ab-1f19ae525a69-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:25 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf" released by "delete_volume" :: held 1.774s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:25 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b638a2c-07ea-4024-bd98-f9a3fd5cfbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f307f4-98e9-44f0-9188-2361724c4b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Created reservations ['d51db526-a773-4862-a4be-e4574532e79d', '04c2515b-d6c5-4bcd-8ef7-77d9a3d62b91', '17a3a0b2-b210-4a4a-acf1-60ecfb979d75', '26ea3631-b598-495f-b28f-f73d0fe55e90'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:25 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee" returned: 0 in 0.918s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Volume volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 (e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501): created successfully Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f307f4-98e9-44f0-9188-2361724c4b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (34bb0b92-9e67-4494-acdb-d88a5480e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:25 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee Jul 09 16:36:25 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ddb50748-524a-43ea-a9f7-a4c0c3b371ff tempest-VolumesSnapshotTestJSON-2022295786 None] Created volume successfully. Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:25 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:25 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:26 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a820aa76-3a95-4f1a-8d37-600df0d915ee" returned: 0 in 0.693s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-quobyte-a820aa76-3a95-4f1a-8d37-600df0d915ee" released by "delete_volume" :: held 1.667s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:26 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.680s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Created reservations ['350e56df-01c1-45fa-a120-43d62c2167c1', 'daaf8bde-197d-4aac-baf9-b5304b4cd2fb', 'd7311fdc-4164-419c-ad9a-bb9dd59e89b7', '97e8473a-209e-4260-a9ec-6903c99f6b7b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Deleted volume successfully. Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2f0b4a24-11ff-4ce3-a785-93b1605bd864 tempest-VolumesActionsTest-458002956 None] Lock "cinder-d7bd1a03-9c1b-4580-a1ca-56717b6d59bf-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:26 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:26 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (761c9d1b-679b-4af1-8fb5-ef2a85ad3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5aa21e-59ef-4afc-9d5b-2557e05d8430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5aa21e-59ef-4afc-9d5b-2557e05d8430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182450376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dccd0d-9874-4e97-9876-aeee33c794b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:27Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbe603c-fba3-477c-b5f3-2938bd046b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbe603c-fba3-477c-b5f3-2938bd046b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38413cd2-4f18-435f-a6e7-4e21aa56e040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38413cd2-4f18-435f-a6e7-4e21aa56e040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47dccd0d-9874-4e97-9876-aeee33c794b8', 'volume_name': 'volume-47dccd0d-9874-4e97-9876-aeee33c794b8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb48f8d-9028-44e5-8f2e-7a7841926bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb48f8d-9028-44e5-8f2e-7a7841926bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e280589-e7ed-423b-911e-436f0b288f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Volume 47dccd0d-9874-4e97-9876-aeee33c794b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47dccd0d-9874-4e97-9876-aeee33c794b8', 'volume_size': 1} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182450376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dccd0d-9874-4e97-9876-aeee33c794b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:27Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Creating volume 47dccd0d-9874-4e97-9876-aeee33c794b8 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:26 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:26 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 1073741824 Jul 09 16:36:26 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:27 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:27 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Deleted volume successfully. Jul 09 16:36:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4082329a-835c-4b0c-8b4d-6a6569beeaf4 tempest-ServersNegativeTestJSON-390004179 None] Lock "cinder-a820aa76-3a95-4f1a-8d37-600df0d915ee-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:27 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 1073741824" returned: 0 in 0.970s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:27 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 Jul 09 16:36:27 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:28 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8" returned: 0 in 0.657s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.271s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e280589-e7ed-423b-911e-436f0b288f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47dccd0d-9874-4e97-9876-aeee33c794b8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e981ed53-4bc7-4c41-a0ee-fb3d57d79394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Creating offline snapshot 9fd16966-8608-44af-ab67-7af3d3dd6680 of volume e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:36:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Volume volume-47dccd0d-9874-4e97-9876-aeee33c794b8 (47dccd0d-9874-4e97-9876-aeee33c794b8): created successfully Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e981ed53-4bc7-4c41-a0ee-fb3d57d79394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (761c9d1b-679b-4af1-8fb5-ef2a85ad3536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a1bb68-9c7b-4454-9b3a-1df59a14963f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2c099779-4b91-4224-b8c7-832854f4331b tempest-VolumesActionsTest-840040933 None] Created volume successfully. Jul 09 16:36:28 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 Jul 09 16:36:28 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:28 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:28 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-47dccd0d-9874-4e97-9876-aeee33c794b8-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Lock "cinder-47dccd0d-9874-4e97-9876-aeee33c794b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:28 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=107,cinder:UPDATE=106,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-quobyte-47dccd0d-9874-4e97-9876-aeee33c794b8" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-47dccd0d-9874-4e97-9876-aeee33c794b8" acquired by "delete_volume" :: waited 0.050s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd36b2a-bbe5-42ad-a9c3-d9a93f5a7aec]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:29 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 Jul 09 16:36:29 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:29 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" returned: 0 in 1.090s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:29 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 1G Jul 09 16:36:29 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:29 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.165s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:36:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:36:30 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8" returned: 0 in 1.196s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:30 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8 Jul 09 16:36:30 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-8de96a56-c47d-4d1a-91e2-ca4cf049f663 req-1bd15c51-9ad8-4f1c-8560-9975ae89bb23 tempest-AttachVolumeNegativeTest-1472508837 None] Terminate volume connection completed successfully. Jul 09 16:36:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-8de96a56-c47d-4d1a-91e2-ca4cf049f663 req-1bd15c51-9ad8-4f1c-8560-9975ae89bb23 tempest-AttachVolumeNegativeTest-1472508837 None] Deleting attachment 8661d352-b74b-4c3f-8e20-8ac5033bdd2e. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:36:30 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 1G" returned: 0 in 1.236s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:30 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 Jul 09 16:36:30 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:31 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47dccd0d-9874-4e97-9876-aeee33c794b8" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-47dccd0d-9874-4e97-9876-aeee33c794b8" released by "delete_volume" :: held 2.174s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Created reservations ['154743ac-e989-4794-9cbf-c1f0f27ef9fd', '7d994496-a728-4cb3-8cf0-fa4f7494d1c4', '0f5238b7-519e-41b4-8baf-06d956248369', 'd4c1da51-cb72-479d-ba1c-bd68d7d13ac3'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:31 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:31 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:31 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:31 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 is being set with open permissions: ugo+rw Jul 09 16:36:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:31 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 Jul 09 16:36:31 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:32 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Deleted volume successfully. Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6b3131db-a883-4e89-ad9f-e1fdc13d2b3c tempest-VolumesActionsTest-458002956 None] Lock "cinder-47dccd0d-9874-4e97-9876-aeee33c794b8-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:32 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680" returned: 0 in 0.648s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:32 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.info Jul 09 16:36:32 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (abc34433-c8c0-47b0-a06e-d913c90b980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a89cd43-5b21-41e4-bc30-e97778160f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a89cd43-5b21-41e4-bc30-e97778160f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1767748970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:33Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c88c77-ba7a-4d9a-b4d5-eea84f92a4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c88c77-ba7a-4d9a-b4d5-eea84f92a4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287ca85f-8e18-4bfe-85d8-a111680a081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287ca85f-8e18-4bfe-85d8-a111680a081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70', 'volume_name': 'volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5844ec16-8976-4bde-8b68-216b2352423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5844ec16-8976-4bde-8b68-216b2352423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a35d4c-2ce8-468a-a553-d18713f51ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Volume a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70', 'volume_size': 1} Jul 09 16:36:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:33 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.info" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:33 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.info is being set with open permissions: ugo+rw Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:33 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.info Jul 09 16:36:33 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:33 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.info" returned: 0 in 0.667s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.331s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1767748970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:33Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Creating volume a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:33 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:33 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 1073741824 Jul 09 16:36:33 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d16023e5-fc99-4b2e-bba1-be794ffa16ad tempest-VolumesSnapshotTestJSON-2022295786 None] Create snapshot completed successfully Jul 09 16:36:34 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 1073741824" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:34 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 Jul 09 16:36:34 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (6fb6fdb3-c9aa-432d-bad0-7c14f56664cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3c25b5-7d14-457e-a531-90571f41f558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3c25b5-7d14-457e-a531-90571f41f558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1914257658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4468ef-f32d-46cb-bfbc-3019cb33f922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baba5d0a20a340bda1aa35fe0e7d04d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9fd16966-8608-44af-ab67-7af3d3dd6680,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:35Z,use_quota=True,user_id='86b1f4f931f34e3d95d4d2609ddd2c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37953c4-6fa0-4256-bd0c-9f4f31417fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37953c4-6fa0-4256-bd0c-9f4f31417fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2167adc0-5b02-4129-9b0d-4daf8c8e9108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2167adc0-5b02-4129-9b0d-4daf8c8e9108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf4468ef-f32d-46cb-bfbc-3019cb33f922', 'volume_name': 'volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922', 'volume_size': 1, 'snapshot_id': '9fd16966-8608-44af-ab67-7af3d3dd6680'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d644fb-5971-44cd-a668-afb8e4dda677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d644fb-5971-44cd-a668-afb8e4dda677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5c6779-cb8b-42d5-9643-922d714b0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume bf4468ef-f32d-46cb-bfbc-3019cb33f922: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922', 'volume_size': 1, 'snapshot_id': '9fd16966-8608-44af-ab67-7af3d3dd6680'} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:35 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70" returned: 0 in 0.969s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.245s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-9fd16966-8608-44af-ab67-7af3d3dd6680-bf4468ef-f32d-46cb-bfbc-3019cb33f922" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a35d4c-2ce8-468a-a553-d18713f51ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c27679-27ee-4fc5-a14c-e5a657425f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-9fd16966-8608-44af-ab67-7af3d3dd6680-bf4468ef-f32d-46cb-bfbc-3019cb33f922" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Creating volume bf4468ef-f32d-46cb-bfbc-3019cb33f922 from snapshot 9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-bf4468ef-f32d-46cb-bfbc-3019cb33f922" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-bf4468ef-f32d-46cb-bfbc-3019cb33f922" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] snapshot: 9fd16966-8608-44af-ab67-7af3d3dd6680, volume: bf4468ef-f32d-46cb-bfbc-3019cb33f922, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:36:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Volume volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 (a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70): created successfully Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c27679-27ee-4fc5-a14c-e5a657425f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (abc34433-c8c0-47b0-a06e-d913c90b980d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-36cec283-fec3-4ada-98d4-40c4eb4c8a0b tempest-VolumesActionsTest-840040933 None] Created volume successfully. Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701a515-1d43-4e69-ad86-5c221bec9009]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:35 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 Jul 09 16:36:35 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Lock "cinder-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Acquiring lock "cinder-quobyte-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[624fc30e-fe41-4689-9e2e-1411110176f3]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:36 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 Jul 09 16:36:36 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:36 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680" returned: 0 in 1.031s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b62d90d-4efc-4ca8-9894-b68017ed60a5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:37 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 Jul 09 16:36:37 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:37 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70" returned: 0 in 0.900s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:37 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70 Jul 09 16:36:37 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:37 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:37 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:36:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:37 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 Jul 09 16:36:37 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:38 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Lock "cinder-quobyte-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70" released by "delete_volume" :: held 1.692s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Created reservations ['23020596-5956-46a3-8c90-3a050906f512', 'e5ead08b-f17f-4314-acb1-57a8a0247451', 'a43d0646-54d5-4082-9fa1-c37f9605b88a', '16b3d37f-9a8f-4246-8c45-706759bdfc92'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:38 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:38 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:39 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.451s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:39 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Deleted volume successfully. Jul 09 16:36:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03c0a7ef-f7d6-46bd-9970-772c02ea8558 tempest-VolumesActionsTest-458002956 None] Lock "cinder-a6a0c591-8fd0-4363-8ef1-9dfe8cc47c70-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (bd2dfc82-06d3-40fc-a85c-fb6cbe97e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddd64f0-47d6-493f-95d9-3e44f2ac4134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddd64f0-47d6-493f-95d9-3e44f2ac4134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-319218552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d42234f-267a-4a22-90f9-89c9598ab505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:40Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896afea4-7e4d-46ca-a7e5-02ba093f2277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896afea4-7e4d-46ca-a7e5-02ba093f2277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1035210-2fcb-4e82-8571-7ab716290fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1035210-2fcb-4e82-8571-7ab716290fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d42234f-267a-4a22-90f9-89c9598ab505', 'volume_name': 'volume-6d42234f-267a-4a22-90f9-89c9598ab505', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce1ab42-36cd-4093-8546-13f9ece6b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce1ab42-36cd-4093-8546-13f9ece6b113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb6e7e4-e814-4d7f-9bcf-c3f594e95e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Volume 6d42234f-267a-4a22-90f9-89c9598ab505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d42234f-267a-4a22-90f9-89c9598ab505', 'volume_size': 1} Jul 09 16:36:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:44 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922" returned: 0 in 6.526s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[382f970e-65e2-4ac3-ab6d-3c86a763103c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:44 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 Jul 09 16:36:44 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:45 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" returned: 0 in 1.034s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:45 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:36:45 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Converted 1024.00 MB image at 156.89 MB/s Jul 09 16:36:45 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 is being set with open permissions: ugo+rw Jul 09 16:36:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:45 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 Jul 09 16:36:45 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:46 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922" returned: 0 in 0.731s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-bf4468ef-f32d-46cb-bfbc-3019cb33f922" released by "_copy_volume_from_snapshot" :: held 10.417s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-9fd16966-8608-44af-ab67-7af3d3dd6680-bf4468ef-f32d-46cb-bfbc-3019cb33f922" released by "_create_volume_from_snapshot" :: held 10.456s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.486s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.556s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-319218552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d42234f-267a-4a22-90f9-89c9598ab505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db262cd041054e86ab3eee299e504450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:36:40Z,use_quota=True,user_id='ec8910a3ac474c31acc3da5e613a429a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Creating volume 6d42234f-267a-4a22-90f9-89c9598ab505 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:36:46 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:46 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 1073741824 Jul 09 16:36:46 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5c6779-cb8b-42d5-9643-922d714b0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922', 'volume_size': 1, 'snapshot_id': '9fd16966-8608-44af-ab67-7af3d3dd6680'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00904add-3f54-48fc-b55d-c260a0a2a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Volume volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 (bf4468ef-f32d-46cb-bfbc-3019cb33f922): created successfully Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00904add-3f54-48fc-b55d-c260a0a2a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Flow 'volume_create_manager' (6fb6fdb3-c9aa-432d-bad0-7c14f56664cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d4521f0d-d52f-43d9-80a8-8d8e275f77b1 tempest-VolumesSnapshotTestJSON-2022295786 None] Created volume successfully. Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-bf4468ef-f32d-46cb-bfbc-3019cb33f922-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-bf4468ef-f32d-46cb-bfbc-3019cb33f922-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-bf4468ef-f32d-46cb-bfbc-3019cb33f922" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-bf4468ef-f32d-46cb-bfbc-3019cb33f922" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c3967-bf52-4720-923a-9fc3f45fa2d4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:46 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 Jul 09 16:36:46 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:47 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 1073741824" returned: 0 in 1.135s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:47 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 Jul 09 16:36:47 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:47 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922" returned: 0 in 0.964s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:47 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922 Jul 09 16:36:47 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:48 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb6e7e4-e814-4d7f-9bcf-c3f594e95e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d42234f-267a-4a22-90f9-89c9598ab505', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb1bb36-6065-4452-8c95-debd90cf149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:36:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Volume volume-6d42234f-267a-4a22-90f9-89c9598ab505 (6d42234f-267a-4a22-90f9-89c9598ab505): created successfully Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb1bb36-6065-4452-8c95-debd90cf149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Flow 'volume_create_manager' (bd2dfc82-06d3-40fc-a85c-fb6cbe97e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:36:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eacb8a03-221a-4872-acec-bf69f3ba044d tempest-VolumesActionsTest-840040933 None] Created volume successfully. Jul 09 16:36:48 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf4468ef-f32d-46cb-bfbc-3019cb33f922" returned: 0 in 0.727s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-bf4468ef-f32d-46cb-bfbc-3019cb33f922" released by "delete_volume" :: held 1.753s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['b538c4d1-1f3d-48bc-9868-7b1d79d8740c', '6bfc483c-417f-49ba-9425-0c867d7990af', '2fa008d5-9532-48d6-b540-531aa2aea01a', 'adde736e-553d-4a47-9fe9-94b1e060249c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:48 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:48 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-9fd16966-8608-44af-ab67-7af3d3dd6680-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-9fd16966-8608-44af-ab67-7af3d3dd6680-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-9fd16966-8608-44af-ab67-7af3d3dd6680" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-9fd16966-8608-44af-ab67-7af3d3dd6680" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Deleting offline snapshot 9fd16966-8608-44af-ab67-7af3d3dd6680 of volume e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] snapshot_file for this snap is: volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5a0aaa-29c7-44b8-b9a4-b497a9f027af]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:49 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 Jul 09 16:36:49 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:49 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.887s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Deleted volume successfully. Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-24a0f248-159c-465a-86ca-08de730bb4de tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-bf4468ef-f32d-46cb-bfbc-3019cb33f922-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Acquiring lock "cinder-6d42234f-267a-4a22-90f9-89c9598ab505-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Lock "cinder-6d42234f-267a-4a22-90f9-89c9598ab505-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Acquiring lock "cinder-quobyte-6d42234f-267a-4a22-90f9-89c9598ab505" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Lock "cinder-quobyte-6d42234f-267a-4a22-90f9-89c9598ab505" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a06b7f-b955-4c00-8f1b-fc618459913e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:49 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 Jul 09 16:36:49 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:50 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680" returned: 0 in 0.994s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:36:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1cb0f4-6b09-447b-829a-82622a2c581b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:50 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 Jul 09 16:36:50 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:50 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:50 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505 Jul 09 16:36:50 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:51 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:51 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 Jul 09 16:36:51 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:51 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6d42234f-267a-4a22-90f9-89c9598ab505" returned: 0 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Lock "cinder-quobyte-6d42234f-267a-4a22-90f9-89c9598ab505" released by "delete_volume" :: held 1.838s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Created reservations ['6e741c61-fc2a-41dc-b31a-a6c8f955118a', 'adac1ae1-4299-4daf-8bec-b09f16a623fe', 'd0e1dfdc-fd97-4747-a9a0-0dfe57e91b5e', 'a1082cca-f1f6-4f69-95ba-07595cdb5de6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:51 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:51 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:52 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680" returned: 0 in 1.037s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:52 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680 Jul 09 16:36:52 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:52 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.846s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:52 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Deleted volume successfully. Jul 09 16:36:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-33b68fc1-2423-436b-9005-094415a3f1d1 tempest-VolumesActionsTest-840040933 None] Lock "cinder-6d42234f-267a-4a22-90f9-89c9598ab505-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:52 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501.9fd16966-8608-44af-ab67-7af3d3dd6680" returned: 0 in 0.820s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-9fd16966-8608-44af-ab67-7af3d3dd6680" released by "_delete_snapshot" :: held 3.973s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" released by "delete_snapshot" :: held 4.000s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['c0c06db8-35b6-4c25-ab2d-266e922ad7f1', 'c3c5085a-acde-4bb5-935d-11e1c62f38bf', 'd0b0c0ae-fd53-42a7-9df3-d42aebcdb2bd', 'ee8749a8-7de9-4fd3-9699-87a6036b8126'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Delete snapshot completed successfully. Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d8ba72a-ae98-4867-a5b0-819f314e338e tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-9fd16966-8608-44af-ab67-7af3d3dd6680-delete_snapshot" released by "delete_snapshot" :: held 4.173s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78912b2-b56c-4e34-8630-3e8b8b71a9fd]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:53 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 Jul 09 16:36:53 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:54 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" returned: 0 in 1.129s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:54 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501 Jul 09 16:36:54 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:55 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" returned: 0 in 0.834s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501" released by "delete_volume" :: held 2.054s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['6243474a-6964-4109-97fa-06ecf43a0e93', '9236f595-99d3-4102-915b-1b41168f8f59', '466749a1-4ec6-42c2-90f3-15c2855d0953', '1a5c443a-88dc-406b-b97e-08ff9b37f93a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:55 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:55 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:56 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.668s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:56 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Deleted volume successfully. Jul 09 16:36:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb367e32-2b61-4a51-8d62-c24867f3a561 tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-e22dd0b4-d7bf-41ae-ba1b-4bc57cdf2501-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-431b3f5b-0938-43eb-9ef1-78995c838174-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-431b3f5b-0938-43eb-9ef1-78995c838174-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "cinder-quobyte-431b3f5b-0938-43eb-9ef1-78995c838174" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:36:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-431b3f5b-0938-43eb-9ef1-78995c838174" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:36:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d636ed-86e1-42a5-af03-e97510eb893e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:57 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 Jul 09 16:36:57 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:57 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:57 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174 Jul 09 16:36:57 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:58 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-431b3f5b-0938-43eb-9ef1-78995c838174" returned: 0 in 0.773s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-quobyte-431b3f5b-0938-43eb-9ef1-78995c838174" released by "delete_volume" :: held 1.723s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Created reservations ['03fe04ef-a784-401e-867f-b46885cdfcbf', '6dff82a7-3d4a-426d-ab29-d54a9e4aaa32', '71653fe9-6880-4c5c-8253-059db7a7ccf2', 'f1e3d03c-8f0d-4239-a1e6-cf17ddd4d6c1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:36:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:36:58 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:36:58 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:36:59 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 09 16:36:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:36:59 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:36:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Deleted volume successfully. Jul 09 16:36:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a43e59af-89b9-4600-be0c-2acc0a1c30ab tempest-VolumesSnapshotTestJSON-2022295786 None] Lock "cinder-431b3f5b-0938-43eb-9ef1-78995c838174-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Flow 'volume_create_manager' (f8992c59-5176-4799-bdfb-e9f907de72ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d395193-dcf9-4cc1-a078-75211a5aa65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d395193-dcf9-4cc1-a078-75211a5aa65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1712170710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b1f762-2df7-46ff-80f2-05c8de1b1601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226584d893694e689e0deefd13851c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:07Z,use_quota=True,user_id='eac5e122c6d24950b7efdf1c7ceb1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5889c0-8aa4-43b9-b48c-d61f46725758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5889c0-8aa4-43b9-b48c-d61f46725758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096710d3-ccf0-44f1-b9c1-eb1e59477dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096710d3-ccf0-44f1-b9c1-eb1e59477dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b1f762-2df7-46ff-80f2-05c8de1b1601', 'volume_name': 'volume-45b1f762-2df7-46ff-80f2-05c8de1b1601', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0afb8ff-087f-4f85-aadd-d907485beded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0afb8ff-087f-4f85-aadd-d907485beded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73224727-8e52-43f4-b9b8-343ca1d3ab9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Volume 45b1f762-2df7-46ff-80f2-05c8de1b1601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b1f762-2df7-46ff-80f2-05c8de1b1601', 'volume_size': 1} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1712170710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b1f762-2df7-46ff-80f2-05c8de1b1601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='226584d893694e689e0deefd13851c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:07Z,use_quota=True,user_id='eac5e122c6d24950b7efdf1c7ceb1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Creating volume 45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:37:07 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:37:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:07 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 1073741824 Jul 09 16:37:07 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:08 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 1073741824" returned: 0 in 1.409s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:08 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 Jul 09 16:37:08 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:10 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601" returned: 0 in 1.202s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] <== create_volume: return (2690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:37:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73224727-8e52-43f4-b9b8-343ca1d3ab9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b1f762-2df7-46ff-80f2-05c8de1b1601', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb334fec-32a0-45ae-87b2-2377ffec1d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Volume volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 (45b1f762-2df7-46ff-80f2-05c8de1b1601): created successfully Jul 09 16:37:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb334fec-32a0-45ae-87b2-2377ffec1d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Flow 'volume_create_manager' (f8992c59-5176-4799-bdfb-e9f907de72ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dc12c8c9-1142-467c-bd92-9b78103fed70 tempest-VolumesSnapshotListTestJSON-460184543 None] Created volume successfully. Jul 09 16:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Creating offline snapshot 0986e69b-6d40-47be-836b-876a309c7b66 of volume 45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:37:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1834405-3a42-451e-bfbf-e8d824af785e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:11 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 Jul 09 16:37:11 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:12 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601" returned: 0 in 1.396s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:12 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 1G Jul 09 16:37:12 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Flow 'volume_create_manager' (fd15bf87-f5c3-4d92-94cd-c07d592bb0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e900b4-73af-4117-b685-f315bdb0a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e900b4-73af-4117-b685-f315bdb0a072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1192869385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0658bdb-16b6-4259-b787-cbec2f24295f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067d427a651c4a4ba8d982d7ba90dd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:14Z,use_quota=True,user_id='c4e7334ea1d744429d2f0854d3b95caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48486e5-ffd6-4bae-bf88-ad20a69dab4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48486e5-ffd6-4bae-bf88-ad20a69dab4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423b4a20-ccb0-4146-b5da-24181a058755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423b4a20-ccb0-4146-b5da-24181a058755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0658bdb-16b6-4259-b787-cbec2f24295f', 'volume_name': 'volume-a0658bdb-16b6-4259-b787-cbec2f24295f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff27f09-7bcd-4031-a43e-74fbb336f73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff27f09-7bcd-4031-a43e-74fbb336f73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4046a551-0cf8-48e8-9a3a-410b0a6b33cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Volume a0658bdb-16b6-4259-b787-cbec2f24295f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0658bdb-16b6-4259-b787-cbec2f24295f', 'volume_size': 1} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:13 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 1G" returned: 0 in 1.401s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:13 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 Jul 09 16:37:13 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:14 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:14 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 is being set with open permissions: ugo+rw Jul 09 16:37:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:14 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 Jul 09 16:37:14 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:15 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66" returned: 0 in 1.053s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:15 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.info Jul 09 16:37:15 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:16 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.info" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:16 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.info is being set with open permissions: ugo+rw Jul 09 16:37:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:16 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.info Jul 09 16:37:16 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:17 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.info" returned: 0 in 0.681s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.323s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.696s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1192869385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0658bdb-16b6-4259-b787-cbec2f24295f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067d427a651c4a4ba8d982d7ba90dd4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:14Z,use_quota=True,user_id='c4e7334ea1d744429d2f0854d3b95caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Creating volume a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:37:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:37:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:17 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f 1073741824 Jul 09 16:37:17 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-813080b1-dc49-4777-9cd2-7844c24014e1 tempest-VolumesSnapshotListTestJSON-460184543 None] Create snapshot completed successfully Jul 09 16:37:18 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f 1073741824" returned: 0 in 1.006s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:18 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f Jul 09 16:37:18 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:19 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.646s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4046a551-0cf8-48e8-9a3a-410b0a6b33cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0658bdb-16b6-4259-b787-cbec2f24295f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f48aec-d97a-45bf-887d-11bfbb89f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Creating offline snapshot a301800e-935a-43db-a240-2c41569c72de of volume 45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:37:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Volume volume-a0658bdb-16b6-4259-b787-cbec2f24295f (a0658bdb-16b6-4259-b787-cbec2f24295f): created successfully Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f48aec-d97a-45bf-887d-11bfbb89f415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Flow 'volume_create_manager' (fd15bf87-f5c3-4d92-94cd-c07d592bb0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3a3d27-530d-4b4c-b658-d94d14e772af]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c48a20c8-829c-42d6-a309-3292f0de6140 tempest-SnapshotMetadataTestJSON-1600846850 None] Created volume successfully. Jul 09 16:37:19 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 Jul 09 16:37:19 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:20 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=92,cinder:DELETE=13,cinder:INSERT=31,cinder:UPDATE=120 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:37:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:20 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66" returned: 0 in 0.937s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1f762-2df7-46ff-80f2-05c8de1b1601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:20 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de 1G Jul 09 16:37:20 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:21 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de 1G" returned: 0 in 0.924s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:21 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de Jul 09 16:37:21 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:22 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:22 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de is being set with open permissions: ugo+rw Jul 09 16:37:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:22 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de Jul 09 16:37:22 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:22 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.579s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.660s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Creating offline snapshot c3ca345f-cf87-4caa-9c3b-236755de180e of volume a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:37:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eabd7397-67c1-4d50-9589-41736d3d29e6 tempest-VolumesSnapshotListTestJSON-460184543 None] Create snapshot completed successfully Jul 09 16:37:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[584fd232-fe2a-4ef9-bc93-22442c973cf6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:23 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f Jul 09 16:37:23 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:23 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:23 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e 1G Jul 09 16:37:23 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:24 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e 1G" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0658bdb-16b6-4259-b787-cbec2f24295f -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:24 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0658bdb-16b6-4259-b787-cbec2f24295f -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e Jul 09 16:37:24 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:25 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0658bdb-16b6-4259-b787-cbec2f24295f -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e" returned: 0 in 0.693s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:25 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e is being set with open permissions: ugo+rw Jul 09 16:37:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:25 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e Jul 09 16:37:25 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:26 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e" returned: 0 in 0.652s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:26 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.info Jul 09 16:37:26 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:26 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.info" returned: 0 in 0.670s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.info is being set with open permissions: ugo+rw Jul 09 16:37:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:26 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.info Jul 09 16:37:26 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:27 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.info" returned: 0 in 0.646s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.390s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.184s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Creating offline snapshot b02dd6df-fa23-4077-839d-cff331111992 of volume 45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:37:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e7460291-48fe-4fb8-a17a-a4fb37775097 tempest-SnapshotMetadataTestJSON-1600846850 None] Create snapshot completed successfully Jul 09 16:37:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d3d6b-bfd8-4ae3-817f-799db3afa420]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:27 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de Jul 09 16:37:27 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:28 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de" returned: 0 in 1.034s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1f762-2df7-46ff-80f2-05c8de1b1601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:28 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 1G Jul 09 16:37:28 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "cinder-c3ca345f-cf87-4caa-9c3b-236755de180e-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-c3ca345f-cf87-4caa-9c3b-236755de180e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "cinder-quobyte-a0658bdb-16b6-4259-b787-cbec2f24295f" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-quobyte-a0658bdb-16b6-4259-b787-cbec2f24295f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "cinder-quobyte-c3ca345f-cf87-4caa-9c3b-236755de180e" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-quobyte-c3ca345f-cf87-4caa-9c3b-236755de180e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Deleting offline snapshot c3ca345f-cf87-4caa-9c3b-236755de180e of volume a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] snapshot_file for this snap is: volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a7e07-093d-4034-8c8a-dcf3290bc875]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:28 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:37:28 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:29 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e Jul 09 16:37:29 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:29 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.079s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:37:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:37:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 8 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:37:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:37:30 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 1G" returned: 0 in 1.518s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:30 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 Jul 09 16:37:30 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:30 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e" returned: 0 in 1.324s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0658bdb-16b6-4259-b787-cbec2f24295f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2aef2d-1098-4f49-836c-065ee6824b40]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:30 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f Jul 09 16:37:30 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:31 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992" returned: 0 in 0.989s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:31 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 is being set with open permissions: ugo+rw Jul 09 16:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:31 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 Jul 09 16:37:31 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:31 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f" returned: 0 in 1.254s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:31 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e Jul 09 16:37:31 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:31 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992" returned: 0 in 0.736s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:31 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=62,cinder:INSERT=17,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:37:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-845e88ef-a728-4221-96b1-34fa968394a3 tempest-VolumesSnapshotListTestJSON-460184543 None] Create snapshot completed successfully Jul 09 16:37:32 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e" returned: 0 in 0.772s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:32 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e Jul 09 16:37:32 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:32 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f.c3ca345f-cf87-4caa-9c3b-236755de180e" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-quobyte-c3ca345f-cf87-4caa-9c3b-236755de180e" released by "_delete_snapshot" :: held 4.238s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-quobyte-a0658bdb-16b6-4259-b787-cbec2f24295f" released by "delete_snapshot" :: held 4.278s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Created reservations ['1b01d327-3005-4953-bcda-9fbc7d23df6d', 'fb0dd77a-8666-4c9e-83dd-42e418099064', 'cf78d25d-f287-470d-9a69-37681034434c', 'ee03d35a-65af-4498-8ada-762dac7ed8ad'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Delete snapshot completed successfully. Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f46cd241-aed4-48f9-aadc-4eb293944d61 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-c3ca345f-cf87-4caa-9c3b-236755de180e-delete_snapshot" released by "delete_snapshot" :: held 4.467s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Flow 'volume_create_manager' (aba11e49-b341-412c-87d1-ae1c60077f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe3d2d9-3bea-4805-a749-be2b72e3728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe3d2d9-3bea-4805-a749-be2b72e3728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-475680410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747dcba459b74f5d8622a6e98af26454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:33Z,use_quota=True,user_id='a393a3fcdbac4088aaa1066cc529622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db0bcce-2780-4c22-9151-abab2205e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db0bcce-2780-4c22-9151-abab2205e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3234ac-5a78-418b-a1bd-ff3a57d781f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3234ac-5a78-418b-a1bd-ff3a57d781f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d', 'volume_name': 'volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfc8fef-e6e6-41ec-99b5-9688f6722f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfc8fef-e6e6-41ec-99b5-9688f6722f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e570c4-02d5-4531-8ab8-aca65b13ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Volume e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d', 'volume_size': 1} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-475680410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='747dcba459b74f5d8622a6e98af26454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:33Z,use_quota=True,user_id='a393a3fcdbac4088aaa1066cc529622c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Creating volume e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:37:33 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-b02dd6df-fa23-4077-839d-cff331111992-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:33 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d 1073741824 Jul 09 16:37:33 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-b02dd6df-fa23-4077-839d-cff331111992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-quobyte-b02dd6df-fa23-4077-839d-cff331111992" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-b02dd6df-fa23-4077-839d-cff331111992" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Deleting offline snapshot b02dd6df-fa23-4077-839d-cff331111992 of volume 45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] snapshot_file for this snap is: volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b576ecb4-7bb5-45c4-8cdc-17a4e2fac2b5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:33 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 Jul 09 16:37:33 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "cinder-a0658bdb-16b6-4259-b787-cbec2f24295f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-a0658bdb-16b6-4259-b787-cbec2f24295f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "cinder-quobyte-a0658bdb-16b6-4259-b787-cbec2f24295f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-quobyte-a0658bdb-16b6-4259-b787-cbec2f24295f" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a55485-15d8-4e66-b864-1c71c28cba35]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:34 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f Jul 09 16:37:34 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:34 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1f762-2df7-46ff-80f2-05c8de1b1601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:34 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d 1073741824" returned: 0 in 0.917s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[748842cd-2de7-4dd0-9b23-e997c89d2d3e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:34 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d Jul 09 16:37:34 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:34 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de Jul 09 16:37:34 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:34 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:35 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f Jul 09 16:37:35 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:35 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d" returned: 0 in 0.673s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e570c4-02d5-4531-8ab8-aca65b13ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e48418-8219-428e-80a0-631783f35907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Volume volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d (e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d): created successfully Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e48418-8219-428e-80a0-631783f35907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Flow 'volume_create_manager' (aba11e49-b341-412c-87d1-ae1c60077f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:35 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-65b961f8-91d0-4217-ab7e-b70be2824567 tempest-AttachVolumeNegativeTest-1472508837 None] Created volume successfully. Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1f762-2df7-46ff-80f2-05c8de1b1601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:35 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 Jul 09 16:37:35 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:35 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a0658bdb-16b6-4259-b787-cbec2f24295f" returned: 0 in 0.694s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-quobyte-a0658bdb-16b6-4259-b787-cbec2f24295f" released by "delete_volume" :: held 1.554s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Created reservations ['b51e8316-03dc-440b-8363-bad89e66d3a9', '0b20c61d-7021-40c7-938a-546208298b0a', '4914ee9a-688c-45a0-89ea-e8b140bf1adc', '30f0874b-6044-44ae-aa6e-7d362051d8f3'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:35 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:37:35 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:35 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:36 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992 Jul 09 16:37:36 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:36 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:37:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Deleted volume successfully. Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c23b207e-ed83-410a-8744-30ee82023a86 tempest-SnapshotMetadataTestJSON-1600846850 None] Lock "cinder-a0658bdb-16b6-4259-b787-cbec2f24295f-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:36 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.b02dd6df-fa23-4077-839d-cff331111992" returned: 0 in 0.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-b02dd6df-fa23-4077-839d-cff331111992" released by "_delete_snapshot" :: held 3.173s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" released by "delete_snapshot" :: held 3.194s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Created reservations ['93d20874-897d-4ff0-bf16-58685bdc2423', '9da0b37e-9c03-4826-bb98-19a5adb6c398', '3de5235c-4c32-4289-b0cc-1d57ec212f28', 'e9ad27a2-7c17-4379-8d21-2af819344e6d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Delete snapshot completed successfully. Jul 09 16:37:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a468507a-87d6-40b0-a095-fd76ee80ba7c tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-b02dd6df-fa23-4077-839d-cff331111992-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-a301800e-935a-43db-a240-2c41569c72de-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-a301800e-935a-43db-a240-2c41569c72de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-quobyte-a301800e-935a-43db-a240-2c41569c72de" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-a301800e-935a-43db-a240-2c41569c72de" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Deleting offline snapshot a301800e-935a-43db-a240-2c41569c72de of volume 45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] snapshot_file for this snap is: volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb3ad45-46e5-45ae-8fd2-4e483c0fe2a9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:37 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de Jul 09 16:37:37 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:38 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de" returned: 0 in 0.937s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1f762-2df7-46ff-80f2-05c8de1b1601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[86de17c7-8b07-4cf2-935b-7ef8ead91733]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:38 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 Jul 09 16:37:38 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7cffe5fc-2e40-4f8a-bed1-596a066c5967 req-99be9d04-ac51-4e23-856e-89dc86d0265d tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7cffe5fc-2e40-4f8a-bed1-596a066c5967 req-99be9d04-ac51-4e23-856e-89dc86d0265d tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29dc4eb-4d1a-487a-889e-e5f387d5923b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7cffe5fc-2e40-4f8a-bed1-596a066c5967 req-99be9d04-ac51-4e23-856e-89dc86d0265d tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:39 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d Jul 09 16:37:39 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:39 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66" returned: 0 in 1.130s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1f762-2df7-46ff-80f2-05c8de1b1601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:39 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de Jul 09 16:37:39 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:39 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7cffe5fc-2e40-4f8a-bed1-596a066c5967 req-99be9d04-ac51-4e23-856e-89dc86d0265d tempest-AttachVolumeNegativeTest-1472508837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d" returned: 0 in 1.014s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7cffe5fc-2e40-4f8a-bed1-596a066c5967 req-99be9d04-ac51-4e23-856e-89dc86d0265d tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.033s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-7cffe5fc-2e40-4f8a-bed1-596a066c5967 req-99be9d04-ac51-4e23-856e-89dc86d0265d tempest-AttachVolumeNegativeTest-1472508837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b09a8a7-727e-4ad0-a131-bc5337285e87', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:37:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-7cffe5fc-2e40-4f8a-bed1-596a066c5967 req-99be9d04-ac51-4e23-856e-89dc86d0265d tempest-AttachVolumeNegativeTest-1472508837 None] attachment_update completed successfully. Jul 09 16:37:41 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de" returned: 0 in 1.156s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:41 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de Jul 09 16:37:41 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Flow 'volume_create_manager' (bf28e484-9608-44e9-992f-8a7c53a32098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b4c1a-3aa1-4967-9129-764f48558808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b4c1a-3aa1-4967-9129-764f48558808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1628447112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c706d9a-e389-45d7-8c4f-a59192f86232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a9633713c4118aeacd2801bc68496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:41Z,use_quota=True,user_id='b1a7d7781bde44838f7d5e24ff564813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8cbbb5-8f74-4c0c-bcab-64d3612bd2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8cbbb5-8f74-4c0c-bcab-64d3612bd2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c416fe2-0215-4ebf-a158-9690141c8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c416fe2-0215-4ebf-a158-9690141c8184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c706d9a-e389-45d7-8c4f-a59192f86232', 'volume_name': 'volume-9c706d9a-e389-45d7-8c4f-a59192f86232', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2dabe8-9843-4e62-a292-8869f919e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2dabe8-9843-4e62-a292-8869f919e664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb30b51-3881-460f-a3bb-15966dbcf3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Volume 9c706d9a-e389-45d7-8c4f-a59192f86232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c706d9a-e389-45d7-8c4f-a59192f86232', 'volume_size': 1} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1628447112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c706d9a-e389-45d7-8c4f-a59192f86232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a9633713c4118aeacd2801bc68496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:41Z,use_quota=True,user_id='b1a7d7781bde44838f7d5e24ff564813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Creating volume 9c706d9a-e389-45d7-8c4f-a59192f86232 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:37:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:41 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 1073741824 Jul 09 16:37:41 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:41 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.a301800e-935a-43db-a240-2c41569c72de" returned: 0 in 0.807s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-a301800e-935a-43db-a240-2c41569c72de" released by "_delete_snapshot" :: held 4.175s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" released by "delete_snapshot" :: held 4.198s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Created reservations ['d4fdb089-72a5-46dc-aedb-2ef7ba93fad2', 'b3d6a61e-8fa8-401e-9f1e-9e8fce07143e', '8ca32ee9-e280-4276-8e4b-d7d286b485a3', '7a6fdf2a-6a97-43dd-bf2b-5429c7be34b7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Delete snapshot completed successfully. Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f265f2fa-5e28-4fd1-acfc-f25163908353 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-a301800e-935a-43db-a240-2c41569c72de-delete_snapshot" released by "delete_snapshot" :: held 4.377s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:42 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 1073741824" returned: 0 in 0.916s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:42 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 Jul 09 16:37:42 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Flow 'volume_create_manager' (1e06dd93-ea2d-4d73-86e7-7132257a53e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e041208-cec0-487b-a9a6-eaa1e5226015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e041208-cec0-487b-a9a6-eaa1e5226015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1415124661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea6dc1f7df4de299e53ef08c09ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:43Z,use_quota=True,user_id='8eed3fcee47d49f78d5e1afc3636a0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3033c5-d60d-4a3f-8c37-b15d8a838f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3033c5-d60d-4a3f-8c37-b15d8a838f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866c2d3d-685b-4553-b103-a3ecca4ffe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866c2d3d-685b-4553-b103-a3ecca4ffe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045', 'volume_name': 'volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff92ef0-8b66-45e0-a47a-b5734490974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff92ef0-8b66-45e0-a47a-b5734490974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b78b16-9c82-40be-bf7b-d09d4e72ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Volume fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045', 'volume_size': 1} Jul 09 16:37:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-0986e69b-6d40-47be-836b-876a309c7b66-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-0986e69b-6d40-47be-836b-876a309c7b66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-quobyte-0986e69b-6d40-47be-836b-876a309c7b66" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-0986e69b-6d40-47be-836b-876a309c7b66" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Deleting offline snapshot 0986e69b-6d40-47be-836b-876a309c7b66 of volume 45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] snapshot_file for this snap is: volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd1f0a-acca-4851-a197-b4dd360014ad]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:43 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232" returned: 0 in 0.681s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1415124661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ea6dc1f7df4de299e53ef08c09ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:43Z,use_quota=True,user_id='8eed3fcee47d49f78d5e1afc3636a0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Creating volume fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:37:43 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:43 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 1073741824 Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb30b51-3881-460f-a3bb-15966dbcf3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c706d9a-e389-45d7-8c4f-a59192f86232', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:43 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9d683c-6008-4601-9c7e-0ea4e108c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Volume volume-9c706d9a-e389-45d7-8c4f-a59192f86232 (9c706d9a-e389-45d7-8c4f-a59192f86232): created successfully Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9d683c-6008-4601-9c7e-0ea4e108c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:43 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 Jul 09 16:37:43 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Flow 'volume_create_manager' (bf28e484-9608-44e9-992f-8a7c53a32098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-609695c9-bf56-4dd7-b2b3-3734f69f2c14 tempest-VolumesTransfersTest-1474796928 None] Created volume successfully. Jul 09 16:37:43 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66" returned: 0 in 0.869s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1f762-2df7-46ff-80f2-05c8de1b1601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[427cc57e-adf3-4dda-ad78-9cc85bd837c4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:44 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 1073741824" returned: 0 in 0.934s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:44 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 Jul 09 16:37:44 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:44 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 Jul 09 16:37:44 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b37aaab3-5cfd-474b-850e-c7038086e7af tempest-VolumesTransfersTest-587472109 None] Transfer volume completed successfully. Jul 09 16:37:44 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045" returned: 0 in 0.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:37:44 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601" returned: 0 in 0.813s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b78b16-9c82-40be-bf7b-d09d4e72ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:44 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 Jul 09 16:37:44 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5e5436-5fa9-4397-8c65-dab877752ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Volume volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 (fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045): created successfully Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5e5436-5fa9-4397-8c65-dab877752ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Flow 'volume_create_manager' (1e06dd93-ea2d-4d73-86e7-7132257a53e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-66659811-e904-4150-83d9-fb8c056a3e5b tempest-AttachVolumeShelveTestJSON-50653402 None] Created volume successfully. Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Acquiring lock "cinder-9c706d9a-e389-45d7-8c4f-a59192f86232-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-9c706d9a-e389-45d7-8c4f-a59192f86232-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Acquiring lock "cinder-quobyte-9c706d9a-e389-45d7-8c4f-a59192f86232" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-quobyte-9c706d9a-e389-45d7-8c4f-a59192f86232" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d683dd9b-4304-4348-9f12-64f8470b7216]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:45 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 Jul 09 16:37:45 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:45 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:45 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66 Jul 09 16:37:45 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:46 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:46 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232 Jul 09 16:37:46 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:46 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601.0986e69b-6d40-47be-836b-876a309c7b66" returned: 0 in 0.670s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-0986e69b-6d40-47be-836b-876a309c7b66" released by "_delete_snapshot" :: held 3.281s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" released by "delete_snapshot" :: held 3.308s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Created reservations ['0b27d7ce-9cff-4141-851c-f4ef43bb89d1', '16930095-e080-4e3e-8529-f2bbbfbcd3c3', '9b75a283-2f29-4dd7-be9b-e6c45ef2f103', 'c4f122de-3168-41c3-88ee-1f08b59c0d7b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Delete snapshot completed successfully. Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-867ed8b2-1ed8-4c1d-ad24-d20e9a4f7f87 tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-0986e69b-6d40-47be-836b-876a309c7b66-delete_snapshot" released by "delete_snapshot" :: held 3.464s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:46 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c706d9a-e389-45d7-8c4f-a59192f86232" returned: 0 in 0.705s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-quobyte-9c706d9a-e389-45d7-8c4f-a59192f86232" released by "delete_volume" :: held 1.536s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Created reservations ['0293667d-504e-4030-8672-6627b3086d97', '89ad855b-da8f-473c-8406-f7bd43a22dad', 'a93fe0db-78c9-41e6-949c-290ea13abc81', 'c6a5237c-8f68-4699-972b-1a6cf770c04d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:46 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:37:46 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-81eb9a8a-562d-4342-8881-2a52e97451b4 req-0350cd71-d72c-4d4e-9f73-5bb94f912448 tempest-AttachVolumeNegativeTest-1472508837 None] Terminate volume connection completed successfully. Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-81eb9a8a-562d-4342-8881-2a52e97451b4 req-0350cd71-d72c-4d4e-9f73-5bb94f912448 tempest-AttachVolumeNegativeTest-1472508837 None] Deleting attachment 9b09a8a7-727e-4ad0-a131-bc5337285e87. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-45b1f762-2df7-46ff-80f2-05c8de1b1601-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-45b1f762-2df7-46ff-80f2-05c8de1b1601-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2503ca7f-9e61-4ebe-9d56-a0e6986fc383]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:47 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 Jul 09 16:37:47 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:47 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:37:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Deleted volume successfully. Jul 09 16:37:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-79d4b8d2-781f-4006-8af9-319f3b5c8a41 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-9c706d9a-e389-45d7-8c4f-a59192f86232-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Flow 'volume_create_manager' (2f772738-51b7-40c6-8ea9-d6569a0b6707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210d4df5-3953-4d02-a4ad-1e4bfbc38f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210d4df5-3953-4d02-a4ad-1e4bfbc38f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-251272734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de54b089-cedb-4209-8345-12bfed95d2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a9633713c4118aeacd2801bc68496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:48Z,use_quota=True,user_id='b1a7d7781bde44838f7d5e24ff564813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a05e041-e04f-428c-a390-d547853eea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a05e041-e04f-428c-a390-d547853eea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a9f38a-d003-4956-9853-e11ac610b81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a9f38a-d003-4956-9853-e11ac610b81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de54b089-cedb-4209-8345-12bfed95d2d4', 'volume_name': 'volume-de54b089-cedb-4209-8345-12bfed95d2d4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac82eefa-d787-487d-9528-8ef5e880335f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac82eefa-d787-487d-9528-8ef5e880335f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eaa90d-e1c1-46b3-99a7-c693dbef1cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Volume de54b089-cedb-4209-8345-12bfed95d2d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de54b089-cedb-4209-8345-12bfed95d2d4', 'volume_size': 1} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-251272734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de54b089-cedb-4209-8345-12bfed95d2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a9633713c4118aeacd2801bc68496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:37:48Z,use_quota=True,user_id='b1a7d7781bde44838f7d5e24ff564813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Creating volume de54b089-cedb-4209-8345-12bfed95d2d4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:37:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:48 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 1073741824 Jul 09 16:37:48 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:48 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:48 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601 Jul 09 16:37:48 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:49 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-45b1f762-2df7-46ff-80f2-05c8de1b1601" returned: 0 in 0.711s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-quobyte-45b1f762-2df7-46ff-80f2-05c8de1b1601" released by "delete_volume" :: held 1.656s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Created reservations ['a23d5899-8835-4096-a2c4-8cc5c0ff1867', 'a9728f7d-1236-44dd-aa2f-47c200a0d0c4', 'bc1cf0be-b00b-433c-ba7f-e987922ff46e', 'cdb448cc-f138-4add-bdc6-2e16ee3e1116'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:49 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 1073741824" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:49 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 Jul 09 16:37:49 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:49 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:37:49 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:49 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4" returned: 0 in 0.731s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21eaa90d-e1c1-46b3-99a7-c693dbef1cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de54b089-cedb-4209-8345-12bfed95d2d4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af169665-8268-4a4a-b558-72a85a21bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:37:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Volume volume-de54b089-cedb-4209-8345-12bfed95d2d4 (de54b089-cedb-4209-8345-12bfed95d2d4): created successfully Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af169665-8268-4a4a-b558-72a85a21bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:37:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Flow 'volume_create_manager' (2f772738-51b7-40c6-8ea9-d6569a0b6707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:37:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6b861bea-b0e3-4337-ac65-13f25e04d290 tempest-VolumesTransfersTest-1474796928 None] Created volume successfully. Jul 09 16:37:50 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:37:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Deleted volume successfully. Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-870a7c2f-235b-4287-b341-e36c0a08a42d tempest-VolumesSnapshotListTestJSON-460184543 None] Lock "cinder-45b1f762-2df7-46ff-80f2-05c8de1b1601-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Acquiring lock "cinder-de54b089-cedb-4209-8345-12bfed95d2d4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-de54b089-cedb-4209-8345-12bfed95d2d4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Acquiring lock "cinder-quobyte-de54b089-cedb-4209-8345-12bfed95d2d4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-quobyte-de54b089-cedb-4209-8345-12bfed95d2d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[98088bc1-a486-4540-944b-45abef440bee]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:37:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:50 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 Jul 09 16:37:50 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:51 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4" returned: 0 in 1.192s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:51 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4 Jul 09 16:37:51 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:52 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de54b089-cedb-4209-8345-12bfed95d2d4" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-quobyte-de54b089-cedb-4209-8345-12bfed95d2d4" released by "delete_volume" :: held 2.202s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Created reservations ['89dea61d-ac3a-4792-920e-51c81f0703f3', 'deef508f-bfdb-4e39-b4d1-9842bd3d16c5', '7b37492c-d73e-46ef-8888-6686ec331c1d', '6583f69b-ee6e-4745-8533-dbc5e5bf8c95'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:37:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:37:52 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:37:52 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:37:53 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 09 16:37:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.889s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:37:53 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:37:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Deleted volume successfully. Jul 09 16:37:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-72e625a0-8fbd-4deb-b98c-a55f192d9a72 tempest-VolumesTransfersTest-1664197132 None] Lock "cinder-de54b089-cedb-4209-8345-12bfed95d2d4-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "cinder-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "cinder-quobyte-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-quobyte-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e303c-d473-4d7f-87c5-90d61f4b9677]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:00 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d Jul 09 16:38:00 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:01 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d" returned: 0 in 0.909s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:01 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d Jul 09 16:38:01 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:02 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-quobyte-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d" released by "delete_volume" :: held 1.794s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Created reservations ['161dd14c-53f2-4c96-93ef-ed852efef4e8', '7aec1eca-58f2-4be8-9abd-39b3124c65f2', '77adb38d-fa73-4cf4-9d0d-fb515659d01a', '319fcc9c-1c75-49a1-b13d-3cea7b34af54'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:02 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:38:02 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "cinder-846a8bbc-ca2e-4280-b77d-156a2744956e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-846a8bbc-ca2e-4280-b77d-156a2744956e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "cinder-quobyte-846a8bbc-ca2e-4280-b77d-156a2744956e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-quobyte-846a8bbc-ca2e-4280-b77d-156a2744956e" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e898326-95e1-4820-b33c-ccd83d1db440]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:03 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e Jul 09 16:38:03 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:03 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.904s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:38:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Deleted volume successfully. Jul 09 16:38:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cdcc5a9d-fe27-4fd7-b9e4-8c6682168679 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-e64d93a3-ae6a-43d1-b9b2-c34f0a695c5d-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:04 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e" returned: 0 in 1.148s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:04 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e Jul 09 16:38:04 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:04 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-846a8bbc-ca2e-4280-b77d-156a2744956e" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-quobyte-846a8bbc-ca2e-4280-b77d-156a2744956e" released by "delete_volume" :: held 1.991s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Created reservations ['75c40adf-91f9-4845-a212-8812f8aff7a2', 'a506c4d3-c91d-4e65-8c8c-18f6210cfb3b', '970095bc-d51b-4b58-905f-ce529826a7bb', 'c4d3e01b-36a8-4c38-ab6b-dadcef62a73b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:05 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:38:05 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:05 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:38:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Deleted volume successfully. Jul 09 16:38:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-09bf8c36-c304-4279-8545-aafab6d23d6b tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-846a8bbc-ca2e-4280-b77d-156a2744956e-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "cinder-006b7fb2-18cd-481b-9bad-c0f33fed98ad-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-006b7fb2-18cd-481b-9bad-c0f33fed98ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "cinder-quobyte-006b7fb2-18cd-481b-9bad-c0f33fed98ad" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-quobyte-006b7fb2-18cd-481b-9bad-c0f33fed98ad" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[220a9676-8ded-433a-a1e9-1b328e245ce1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:06 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad Jul 09 16:38:06 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:07 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad" returned: 0 in 0.849s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:07 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad Jul 09 16:38:07 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:08 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-006b7fb2-18cd-481b-9bad-c0f33fed98ad" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-quobyte-006b7fb2-18cd-481b-9bad-c0f33fed98ad" released by "delete_volume" :: held 1.665s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Created reservations ['f0a4343b-309b-4a5c-908e-0dff49503f86', '127faa50-b60f-47fc-8234-fe375fa4dd41', '4f97416e-5a60-43a8-ae6b-18221d9d00b7', '6f684e1f-78b1-4036-a02e-e83113c6de3d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:08 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:38:08 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:09 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:38:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Deleted volume successfully. Jul 09 16:38:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-226d131e-b3fa-41fc-bfdd-7966cb1316e4 tempest-AttachVolumeNegativeTest-1472508837 None] Lock "cinder-006b7fb2-18cd-481b-9bad-c0f33fed98ad-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Flow 'volume_create_manager' (61e49eec-2328-46de-aa8f-c6458e9f1687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad11b012-6968-4c6c-a21a-cfe45c8ca525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad11b012-6968-4c6c-a21a-cfe45c8ca525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-684567520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69932682-e9d0-4f89-9aea-cfe45d048a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c957bf0336544699e0f38e44257f0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:14Z,use_quota=True,user_id='a73bb54f431b474f9a7f5f00a8ab66fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1acde0e4-91c0-4125-8f7e-c11c3c2a7d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1acde0e4-91c0-4125-8f7e-c11c3c2a7d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e89421-1238-4142-b02e-45722d2d37fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e89421-1238-4142-b02e-45722d2d37fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69932682-e9d0-4f89-9aea-cfe45d048a3c', 'volume_name': 'volume-69932682-e9d0-4f89-9aea-cfe45d048a3c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0494ffc-1b04-4395-b94b-9df5233004ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0494ffc-1b04-4395-b94b-9df5233004ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d1331-8506-45ac-bfb2-cc0eabc8c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Volume 69932682-e9d0-4f89-9aea-cfe45d048a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69932682-e9d0-4f89-9aea-cfe45d048a3c', 'volume_size': 1} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-684567520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69932682-e9d0-4f89-9aea-cfe45d048a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c957bf0336544699e0f38e44257f0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:14Z,use_quota=True,user_id='a73bb54f431b474f9a7f5f00a8ab66fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Creating volume 69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:38:14 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:38:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:14 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c 1073741824 Jul 09 16:38:14 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:15 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c 1073741824" returned: 0 in 0.955s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:15 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:38:15 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:16 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 0.713s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:38:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d1331-8506-45ac-bfb2-cc0eabc8c197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69932682-e9d0-4f89-9aea-cfe45d048a3c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e317ef52-5e3f-4c97-9d7b-3e0647c688e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:16 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Volume volume-69932682-e9d0-4f89-9aea-cfe45d048a3c (69932682-e9d0-4f89-9aea-cfe45d048a3c): created successfully Jul 09 16:38:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e317ef52-5e3f-4c97-9d7b-3e0647c688e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Flow 'volume_create_manager' (61e49eec-2328-46de-aa8f-c6458e9f1687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d12bca02-09d4-4bed-8433-307448c66a58 tempest-VolumesActionsTest-782127227 None] Created volume successfully. Jul 09 16:38:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-9fd941d6-df73-4d80-b27c-4e427b947e25 req-e9d6a459-2c03-4044-bef4-f71aaf39f8bf tempest-AttachVolumeShelveTestJSON-50653402 None] No connector for attachment 6f16d8b8-b9e2-406d-98dc-f45c875bc958; skipping storage backend terminate_connection call. {{(pid=87204) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 16:38:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-9fd941d6-df73-4d80-b27c-4e427b947e25 req-e9d6a459-2c03-4044-bef4-f71aaf39f8bf tempest-AttachVolumeShelveTestJSON-50653402 None] Deleting attachment 6f16d8b8-b9e2-406d-98dc-f45c875bc958. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Flow 'volume_create_manager' (80eeafdf-d77b-478c-852a-ee2e11e132a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a8270d-cb9e-449a-a188-3de552df3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=80,cinder:UPDATE=94,cinder:DELETE=8,cinder:INSERT=28 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a8270d-cb9e-449a-a188-3de552df3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-50980752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efefa232-efc2-4f75-a7e8-f2ab96eceacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc249b7dc1524c249b9fbf489a7494e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:21Z,use_quota=True,user_id='8e0dd176825243048e25c8bb4112cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(353e2cfe-23f6-4bd6-a1c3-00f9f1c991a6),volume_type_id=353e2cfe-23f6-4bd6-a1c3-00f9f1c991a6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363d7570-1187-482e-9006-d81c4d746161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363d7570-1187-482e-9006-d81c4d746161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee60c62b-5149-413c-a797-0756a4592c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee60c62b-5149-413c-a797-0756a4592c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efefa232-efc2-4f75-a7e8-f2ab96eceacb', 'volume_name': 'volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495cc11d-61d7-453c-a7e8-d09328b8ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495cc11d-61d7-453c-a7e8-d09328b8ba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5741c396-cf49-4392-8049-6121388f034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume efefa232-efc2-4f75-a7e8-f2ab96eceacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb', 'volume_size': 1} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-50980752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efefa232-efc2-4f75-a7e8-f2ab96eceacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc249b7dc1524c249b9fbf489a7494e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:21Z,use_quota=True,user_id='8e0dd176825243048e25c8bb4112cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(353e2cfe-23f6-4bd6-a1c3-00f9f1c991a6),volume_type_id=353e2cfe-23f6-4bd6-a1c3-00f9f1c991a6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Creating volume efefa232-efc2-4f75-a7e8-f2ab96eceacb {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:38:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:38:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:21 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb 1073741824 Jul 09 16:38:21 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Flow 'volume_create_manager' (98473889-396b-4d9f-86b0-1aeab7292840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921d07b1-7a0b-4ec7-9526-05d46516ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921d07b1-7a0b-4ec7-9526-05d46516ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-721957988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff52e8a7-f40f-41e6-81c2-10ce042ad3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc249b7dc1524c249b9fbf489a7494e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:22Z,use_quota=True,user_id='8e0dd176825243048e25c8bb4112cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da6617d3-334f-46af-a2a8-73921bacffe2),volume_type_id=da6617d3-334f-46af-a2a8-73921bacffe2)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a2057b-51d6-4d4f-9685-ce64878fde18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a2057b-51d6-4d4f-9685-ce64878fde18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c625fe1-50d1-4f7a-9ff0-6c1021904925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c625fe1-50d1-4f7a-9ff0-6c1021904925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff52e8a7-f40f-41e6-81c2-10ce042ad3e8', 'volume_name': 'volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4f12a5-716f-4272-9c7e-fd1f770407c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4f12a5-716f-4272-9c7e-fd1f770407c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5dac3a-3b05-4b79-a38b-c6032a9cc00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:22 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume ff52e8a7-f40f-41e6-81c2-10ce042ad3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8', 'volume_size': 1} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:22 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb 1073741824" returned: 0 in 1.276s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:22 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb Jul 09 16:38:22 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Flow 'volume_create_manager' (d8005935-e853-43f4-9611-0c3b71eea9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca973d0e-84ac-4033-bb16-573f51ea04f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca973d0e-84ac-4033-bb16-573f51ea04f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-171886786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee46a6ef-9a27-450c-b41f-47268b85f5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc249b7dc1524c249b9fbf489a7494e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:23Z,use_quota=True,user_id='8e0dd176825243048e25c8bb4112cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dbcdf50-8058-4dd6-b462-df79943b473b),volume_type_id=1dbcdf50-8058-4dd6-b462-df79943b473b)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8637570c-167c-48ec-b15e-e213c951d0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8637570c-167c-48ec-b15e-e213c951d0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d1108e-860d-455b-b269-8275d5d707fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:23 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:38:23 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb" returned: 0 in 1.186s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] <== create_volume: return (2522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.525s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.838s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-721957988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff52e8a7-f40f-41e6-81c2-10ce042ad3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc249b7dc1524c249b9fbf489a7494e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:22Z,use_quota=True,user_id='8e0dd176825243048e25c8bb4112cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da6617d3-334f-46af-a2a8-73921bacffe2),volume_type_id=da6617d3-334f-46af-a2a8-73921bacffe2)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Creating volume ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:38:24 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:24 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 1073741824 Jul 09 16:38:24 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5741c396-cf49-4392-8049-6121388f034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c1abae-1b26-4754-b4fc-c600b3c59447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb (efefa232-efc2-4f75-a7e8-f2ab96eceacb): created successfully Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c1abae-1b26-4754-b4fc-c600b3c59447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Flow 'volume_create_manager' (80eeafdf-d77b-478c-852a-ee2e11e132a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a6b51abd-e9ec-4a70-ab14-6793ab6f4899 tempest-TestInstancesWithCinderVolumes-1985949941 None] Created volume successfully. Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d1108e-860d-455b-b269-8275d5d707fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee46a6ef-9a27-450c-b41f-47268b85f5ea', 'volume_name': 'volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea', 'volume_size': 1, 'image_id': 'ed60b92f-c998-4b55-8786-d77569b09294', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed60b92f-c998-4b55-8786-d77569b09294', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439956070', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc249b7dc1524c249b9fbf489a7494e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed60b92f-c998-4b55-8786-d77569b09294', 'created_at': datetime.datetime(2026, 7, 9, 14, 38, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 38, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed60b92f-c998-4b55-8786-d77569b09294/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d2518c-7a6a-4ad5-9020-ec4943b98f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d2518c-7a6a-4ad5-9020-ec4943b98f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef45c242-6c97-410f-ad7c-f31ff1707cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume ee46a6ef-9a27-450c-b41f-47268b85f5ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea', 'volume_size': 1, 'image_id': 'ed60b92f-c998-4b55-8786-d77569b09294', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed60b92f-c998-4b55-8786-d77569b09294', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439956070', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc249b7dc1524c249b9fbf489a7494e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed60b92f-c998-4b55-8786-d77569b09294', 'created_at': datetime.datetime(2026, 7, 9, 14, 38, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 38, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed60b92f-c998-4b55-8786-d77569b09294/file', 'properties': {}}, 'image_service': } Jul 09 16:38:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Trying to clone ee46a6ef-9a27-450c-b41f-47268b85f5ea from image ed60b92f-c998-4b55-8786-d77569b09294 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ed60b92f-c998-4b55-8786-d77569b09294', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Flow 'volume_create_manager' (fddab543-037b-46b8-8e3f-75017eff53ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2947f16-bab4-41e6-a5e2-ad0fd0bc50ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2947f16-bab4-41e6-a5e2-ad0fd0bc50ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-970173557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f42241-f565-4cc2-8941-e850f61aec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da3342691a9414dbdf24cc396b46614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:26Z,use_quota=True,user_id='3096445d288144a0bc63a58788a06079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c2e6bf-a9f7-4aba-b2e8-35c843cc70e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c2e6bf-a9f7-4aba-b2e8-35c843cc70e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17413eba-492f-454f-8d30-84ddb139fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17413eba-492f-454f-8d30-84ddb139fe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f42241-f565-4cc2-8941-e850f61aec79', 'volume_name': 'volume-11f42241-f565-4cc2-8941-e850f61aec79', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:25 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09433f8b-29cc-4271-8713-e8092de2f9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09433f8b-29cc-4271-8713-e8092de2f9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d1af9a-c5e2-4124-b4cc-735a296fef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Volume 11f42241-f565-4cc2-8941-e850f61aec79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f42241-f565-4cc2-8941-e850f61aec79', 'volume_size': 1} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 1073741824" returned: 0 in 1.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:25 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 Jul 09 16:38:25 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:26 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.668s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-970173557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f42241-f565-4cc2-8941-e850f61aec79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da3342691a9414dbdf24cc396b46614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:26Z,use_quota=True,user_id='3096445d288144a0bc63a58788a06079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Creating volume 11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:38:26 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:26 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 1073741824 Jul 09 16:38:26 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5dac3a-3b05-4b79-a38b-c6032a9cc00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343620c0-2408-426d-a83a-a2f6ea501ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:26 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 (ff52e8a7-f40f-41e6-81c2-10ce042ad3e8): created successfully Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343620c0-2408-426d-a83a-a2f6ea501ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Flow 'volume_create_manager' (98473889-396b-4d9f-86b0-1aeab7292840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b72b1e74-1e81-45b5-a288-a928592bb78a tempest-TestInstancesWithCinderVolumes-1985949941 None] Created volume successfully. Jul 09 16:38:27 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 1073741824" returned: 0 in 1.052s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:27 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 Jul 09 16:38:27 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:28 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d1af9a-c5e2-4124-b4cc-735a296fef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f42241-f565-4cc2-8941-e850f61aec79', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f4554d-9707-46d7-a591-5518cbb1beba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Volume volume-11f42241-f565-4cc2-8941-e850f61aec79 (11f42241-f565-4cc2-8941-e850f61aec79): created successfully Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f4554d-9707-46d7-a591-5518cbb1beba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Flow 'volume_create_manager' (fddab543-037b-46b8-8e3f-75017eff53ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-ac17490e-d3bb-467f-968b-54a697d5ed33 req-570f9f3c-a073-4957-9baa-119036003337 tempest-VolumesSnapshotsTestJSON-2101468481 None] Created volume successfully. Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:28 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:38:28 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD, size 20.69 MB, duration 4.75 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:38:29 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Image download 20.69 MB at 4.36 MB/s Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d513a0-6b5c-4da9-8411-1d6d2fe33955]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:29 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.911s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:38:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:38:29 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD Jul 09 16:38:29 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Creating offline snapshot d1330e75-7aec-42a1-9665-ba07ecae66bc of volume 11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba3646e-948b-4895-a5c1-045f98b1d521]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:30 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 Jul 09 16:38:30 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:30 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD" returned: 0 in 1.122s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Temporary image ed60b92f-c998-4b55-8786-d77569b09294 is fetched for user 8e0dd176825243048e25c8bb4112cbef. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6efc7a2-8067-4ec8-bcb6-87222e0cccc8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:31 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD Jul 09 16:38:31 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:31 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79" returned: 0 in 1.308s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:31 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc 1G Jul 09 16:38:31 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:32 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD" returned: 0 in 1.254s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:32 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc 1G" returned: 0 in 1.194s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f42241-f565-4cc2-8941-e850f61aec79 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:32 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f42241-f565-4cc2-8941-e850f61aec79 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc Jul 09 16:38:32 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:33 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f42241-f565-4cc2-8941-e850f61aec79 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:33 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc is being set with open permissions: ugo+rw Jul 09 16:38:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:33 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc Jul 09 16:38:33 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:34 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:34 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:DELETE=9,cinder:SELECT=82,cinder:INSERT=22,cinder:UPDATE=108 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:38:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:34 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.info Jul 09 16:38:34 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:35 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.info" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:35 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.info is being set with open permissions: ugo+rw Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:35 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.info Jul 09 16:38:35 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:35 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.info" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.800s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.778s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-171886786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee46a6ef-9a27-450c-b41f-47268b85f5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc249b7dc1524c249b9fbf489a7494e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:38:23Z,use_quota=True,user_id='8e0dd176825243048e25c8bb4112cbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dbcdf50-8058-4dd6-b462-df79943b473b),volume_type_id=1dbcdf50-8058-4dd6-b462-df79943b473b)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Creating volume ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:38:35 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:38:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:35 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea 1073741824 Jul 09 16:38:35 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-02c77b48-9bf4-4a37-9166-41b78fb61255 req-afe7b0d7-4aec-419d-acb9-100e6a3cb296 tempest-VolumesSnapshotsTestJSON-2101468481 None] Create snapshot completed successfully Jul 09 16:38:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b6a0ab5-4216-4d8f-8c8e-3106a7cf4761 tempest-VolumesActionsTest-782127227 None] Acquiring lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c" by "attach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b6a0ab5-4216-4d8f-8c8e-3106a7cf4761 tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c" acquired by "attach_volume" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b6a0ab5-4216-4d8f-8c8e-3106a7cf4761 tempest-VolumesActionsTest-782127227 None] Attaching volume 69932682-e9d0-4f89-9aea-cfe45d048a3c to instance fdfe9cbc-b461-40ea-a69d-c9ef19e1a99b at mountpoint /dev/vdb on host None. Jul 09 16:38:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b6a0ab5-4216-4d8f-8c8e-3106a7cf4761 tempest-VolumesActionsTest-782127227 None] Attach volume completed successfully. Jul 09 16:38:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b6a0ab5-4216-4d8f-8c8e-3106a7cf4761 tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c" released by "attach_volume" :: held 0.256s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:37 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea 1073741824" returned: 0 in 1.193s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "cinder-d1330e75-7aec-42a1-9665-ba07ecae66bc-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:37 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:38:37 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-d1330e75-7aec-42a1-9665-ba07ecae66bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "cinder-quobyte-11f42241-f565-4cc2-8941-e850f61aec79" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-quobyte-11f42241-f565-4cc2-8941-e850f61aec79" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "cinder-quobyte-d1330e75-7aec-42a1-9665-ba07ecae66bc" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-quobyte-d1330e75-7aec-42a1-9665-ba07ecae66bc" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Deleting offline snapshot d1330e75-7aec-42a1-9665-ba07ecae66bc of volume 11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] snapshot_file for this snap is: volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ed811-6de7-4dcd-b1b6-7b2f414f5cce]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee0278a9-3d42-45d1-84e0-ad9bcd5b96e3 tempest-VolumesActionsTest-782127227 None] Acquiring lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee0278a9-3d42-45d1-84e0-ad9bcd5b96e3 tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ee0278a9-3d42-45d1-84e0-ad9bcd5b96e3 tempest-VolumesActionsTest-782127227 None] Detaching volume 69932682-e9d0-4f89-9aea-cfe45d048a3c from instance fdfe9cbc-b461-40ea-a69d-c9ef19e1a99b. Jul 09 16:38:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ee0278a9-3d42-45d1-84e0-ad9bcd5b96e3 tempest-VolumesActionsTest-782127227 None] Detach volume completed successfully. Jul 09 16:38:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee0278a9-3d42-45d1-84e0-ad9bcd5b96e3 tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:37 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc Jul 09 16:38:37 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:38 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 0 in 1.358s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] <== create_volume: return (2654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.658s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:38 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Attempting download of ed60b92f-c998-4b55-8786-d77569b09294 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed60b92f-c998-4b55-8786-d77569b09294', 'metadata': {}}])) to volume ee46a6ef-9a27-450c-b41f-47268b85f5ea. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:38:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d0cab-c7e9-4033-a687-5f6f979b6df7]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed60b92f-c998-4b55-8786-d77569b09294_jv1qyguu {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:38 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed60b92f-c998-4b55-8786-d77569b09294_jv1qyguu Jul 09 16:38:38 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:39 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc" returned: 0 in 1.657s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11f42241-f565-4cc2-8941-e850f61aec79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:38:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61826b8-adb5-4596-b033-cef80d0f5374]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:39 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 Jul 09 16:38:39 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:39 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed60b92f-c998-4b55-8786-d77569b09294_jv1qyguu" returned: 0 in 0.956s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed60b92f-c998-4b55-8786-d77569b09294_jv1qyguu {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:39 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed60b92f-c998-4b55-8786-d77569b09294_jv1qyguu Jul 09 16:38:39 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:40 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79" returned: 0 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:40 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc Jul 09 16:38:40 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:40 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed60b92f-c998-4b55-8786-d77569b09294_jv1qyguu" returned: 1 in 1.365s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed60b92f-c998-4b55-8786-d77569b09294_jv1qyguu' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:38:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe86d1d-0527-4166-8fe9-7f8ba54b7a26]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:41 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD Jul 09 16:38:41 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:41 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc" returned: 0 in 1.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:42 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc Jul 09 16:38:42 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:42 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD" returned: 0 in 1.613s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:42 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] ed60b92f-c998-4b55-8786-d77569b09294 was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:42 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:38:42 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:42 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79.d1330e75-7aec-42a1-9665-ba07ecae66bc" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-quobyte-d1330e75-7aec-42a1-9665-ba07ecae66bc" released by "_delete_snapshot" :: held 5.540s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-quobyte-11f42241-f565-4cc2-8941-e850f61aec79" released by "delete_snapshot" :: held 5.618s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:42 devstack cinder-volume[87204]: DEBUG cinder.quota [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Created reservations ['32936cdd-4236-4f93-813e-e193d11bf83e', '823d21b8-d313-4f71-809a-ed2fbc94e9a5', '5847dd41-d77b-49ca-bcc9-a7f7d00a5b26', 'a79d658e-0deb-45e2-ab78-5ea055f59278'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:38:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Delete snapshot completed successfully. Jul 09 16:38:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-34414b10-84ee-4d02-bba8-2ae09ee0a10a req-451bd615-978e-49d5-b49e-b6f99028c634 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-d1330e75-7aec-42a1-9665-ba07ecae66bc-delete_snapshot" released by "delete_snapshot" :: held 5.845s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "cinder-11f42241-f565-4cc2-8941-e850f61aec79-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-11f42241-f565-4cc2-8941-e850f61aec79-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "cinder-quobyte-11f42241-f565-4cc2-8941-e850f61aec79" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-quobyte-11f42241-f565-4cc2-8941-e850f61aec79" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a84f0c-a090-4ecf-adca-fe08ad452a95]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:44 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 Jul 09 16:38:44 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:44 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 0 in 2.150s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ed60b92f-c998-4b55-8786-d77569b09294_m6eqouxjdevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:38:44 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Converted 112.00 MB image at 52.03 MB/s Jul 09 16:38:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:44 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea 1G Jul 09 16:38:44 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:45 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79" returned: 0 in 0.865s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:45 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79 Jul 09 16:38:45 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:45 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea 1G" returned: 0 in 0.757s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f9e509-7350-45a1-a699-3da92da2366e]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:45 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:38:45 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:46 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-11f42241-f565-4cc2-8941-e850f61aec79" returned: 0 in 0.850s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-quobyte-11f42241-f565-4cc2-8941-e850f61aec79" released by "delete_volume" :: held 1.797s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG cinder.quota [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Created reservations ['9ce6f7c3-8fa7-499a-ae3f-32bc3cd9929c', '54785947-6928-482f-ac79-05e1684ec319', 'f9f6364f-84d7-4ba1-adb7-0a0578412247', 'f0726e70-54de-472f-80fd-a854951d919e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:46 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:38:46 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:46 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 0 in 1.005s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:46 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:38:46 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:47 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.manager [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:38:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Deleted volume successfully. Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-df201624-0845-43a6-a32f-3a7a76052821 req-3e6538b9-e6b4-4ae0-9a1f-c9141d574484 tempest-VolumesSnapshotsTestJSON-2101468481 None] Lock "cinder-11f42241-f565-4cc2-8941-e850f61aec79-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:38:47 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 1 in 1.076s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Downloaded image ed60b92f-c998-4b55-8786-d77569b09294 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed60b92f-c998-4b55-8786-d77569b09294', 'metadata': {}}])) to volume ee46a6ef-9a27-450c-b41f-47268b85f5ea successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Temporary image ed60b92f-c998-4b55-8786-d77569b09294 for user 8e0dd176825243048e25c8bb4112cbef is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Marking volume ee46a6ef-9a27-450c-b41f-47268b85f5ea as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Copying metadata from image ed60b92f-c998-4b55-8786-d77569b09294 to ee46a6ef-9a27-450c-b41f-47268b85f5ea. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Creating volume glance metadata for volume ee46a6ef-9a27-450c-b41f-47268b85f5ea backed by image ed60b92f-c998-4b55-8786-d77569b09294 with: {'image_id': 'ed60b92f-c998-4b55-8786-d77569b09294', 'image_name': 'tempest-scenario-img--1439956070', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef45c242-6c97-410f-ad7c-f31ff1707cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea', 'volume_size': 1, 'image_id': 'ed60b92f-c998-4b55-8786-d77569b09294', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed60b92f-c998-4b55-8786-d77569b09294', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1439956070', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fc249b7dc1524c249b9fbf489a7494e5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ed60b92f-c998-4b55-8786-d77569b09294', 'created_at': datetime.datetime(2026, 7, 9, 14, 38, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 38, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed60b92f-c998-4b55-8786-d77569b09294/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca83c5f6-736d-4a8e-94ad-dd9d7e8fe4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:38:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Volume volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea (ee46a6ef-9a27-450c-b41f-47268b85f5ea): created successfully Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca83c5f6-736d-4a8e-94ad-dd9d7e8fe4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:38:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Flow 'volume_create_manager' (d8005935-e853-43f4-9611-0c3b71eea9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:38:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c3e1fe98-94e2-40fd-9748-60fc3c4c0f93 tempest-TestInstancesWithCinderVolumes-1985949941 None] Created volume successfully. Jul 09 16:38:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:38:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:38:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc3905e-871a-4c0f-96c7-6a469f297524]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:38:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:56 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:38:56 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:57 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 0 in 0.927s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:38:57 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:38:57 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:38:58 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Jul 09 16:38:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 1 in 0.961s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:38:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:38:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.955s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:38:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3406d329-6c3a-4e8e-b450-6c3609f1b136', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:38:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-7547017c-2c25-4681-a9be-273e4ece5a62 req-a08fe5ea-2fcd-4ca0-a1b6-eebc2a15df05 tempest-TestInstancesWithCinderVolumes-1985949941 None] attachment_update completed successfully. Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Flow 'volume_create_manager' (846993c7-b45b-453e-9529-730506fe117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb255a8-dba6-48c8-b211-0a7c00b5f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb255a8-dba6-48c8-b211-0a7c00b5f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-216663817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507370d4-5ebd-4151-a4b5-39c358be044d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69a8312a1474b58a93d1d16ca717767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:39:00Z,use_quota=True,user_id='af1293b23d954a14abf25a2bc3189589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5842f33-569a-4526-947d-6806087c72c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5842f33-569a-4526-947d-6806087c72c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af269cc2-3659-4a98-a133-e9919a6089e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af269cc2-3659-4a98-a133-e9919a6089e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507370d4-5ebd-4151-a4b5-39c358be044d', 'volume_name': 'volume-507370d4-5ebd-4151-a4b5-39c358be044d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdb4b58-1d2d-4d18-a7e1-a9b6cae2e3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdb4b58-1d2d-4d18-a7e1-a9b6cae2e3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019bf540-b9b4-4468-8471-a87d97838d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Volume 507370d4-5ebd-4151-a4b5-39c358be044d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507370d4-5ebd-4151-a4b5-39c358be044d', 'volume_size': 1} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-216663817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507370d4-5ebd-4151-a4b5-39c358be044d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69a8312a1474b58a93d1d16ca717767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:39:00Z,use_quota=True,user_id='af1293b23d954a14abf25a2bc3189589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Creating volume 507370d4-5ebd-4151-a4b5-39c358be044d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:39:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:39:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:00 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d 1073741824 Jul 09 16:39:00 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:01 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d 1073741824" returned: 0 in 0.920s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:01 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d Jul 09 16:39:01 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:02 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d" returned: 0 in 0.892s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:39:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019bf540-b9b4-4468-8471-a87d97838d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507370d4-5ebd-4151-a4b5-39c358be044d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9c99b7-8535-4901-8117-02278b5fc8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Volume volume-507370d4-5ebd-4151-a4b5-39c358be044d (507370d4-5ebd-4151-a4b5-39c358be044d): created successfully Jul 09 16:39:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9c99b7-8535-4901-8117-02278b5fc8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Flow 'volume_create_manager' (846993c7-b45b-453e-9529-730506fe117e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:39:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1c5c0d46-8b69-4d11-9548-e922eaf67766 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Created volume successfully. Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01e1799e-67f2-4875-8365-51dc9b68b175 tempest-VolumesActionsTest-782127227 None] Acquiring lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c" by "attach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01e1799e-67f2-4875-8365-51dc9b68b175 tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c" acquired by "attach_volume" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Acquiring lock "cinder-507370d4-5ebd-4151-a4b5-39c358be044d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "cinder-507370d4-5ebd-4151-a4b5-39c358be044d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-01e1799e-67f2-4875-8365-51dc9b68b175 tempest-VolumesActionsTest-782127227 None] Attaching volume 69932682-e9d0-4f89-9aea-cfe45d048a3c to instance 8f6e1648-1f71-4489-97e1-2e0fc3878979 at mountpoint /dev/vdb on host None. Jul 09 16:39:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-01e1799e-67f2-4875-8365-51dc9b68b175 tempest-VolumesActionsTest-782127227 None] Attach volume completed successfully. Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Acquiring lock "cinder-quobyte-507370d4-5ebd-4151-a4b5-39c358be044d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01e1799e-67f2-4875-8365-51dc9b68b175 tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c" released by "attach_volume" :: held 0.188s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "cinder-quobyte-507370d4-5ebd-4151-a4b5-39c358be044d" acquired by "delete_volume" :: waited 0.049s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a8155e-1b7e-4c75-8a76-12c264fbd3a4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:03 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d Jul 09 16:39:03 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03cff987-27a7-4ab2-8fb7-712c47c0768c tempest-VolumesActionsTest-782127227 None] Acquiring lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-detach_volume" by "detach_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03cff987-27a7-4ab2-8fb7-712c47c0768c tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-03cff987-27a7-4ab2-8fb7-712c47c0768c tempest-VolumesActionsTest-782127227 None] Detaching volume 69932682-e9d0-4f89-9aea-cfe45d048a3c from instance 8f6e1648-1f71-4489-97e1-2e0fc3878979. Jul 09 16:39:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-03cff987-27a7-4ab2-8fb7-712c47c0768c tempest-VolumesActionsTest-782127227 None] Detach volume completed successfully. Jul 09 16:39:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-03cff987-27a7-4ab2-8fb7-712c47c0768c tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:04 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d" returned: 0 in 1.058s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:04 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d Jul 09 16:39:04 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:06 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-507370d4-5ebd-4151-a4b5-39c358be044d" returned: 0 in 1.443s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "cinder-quobyte-507370d4-5ebd-4151-a4b5-39c358be044d" released by "delete_volume" :: held 2.575s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Created reservations ['62d2e608-5983-482c-bb6c-59aac70f6b68', 'bde67a5b-8c4f-4ea1-8031-0f7461fd523e', '3a5062ab-cd1d-42fe-8ce0-9ab2d81423f6', '3b8e5d07-d8bf-4082-a1eb-cf5ecf6dead0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:06 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:39:06 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:07 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.432s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:07 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:39:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Deleted volume successfully. Jul 09 16:39:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3f57dd0-93ae-4df2-a605-11d960d05505 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "cinder-507370d4-5ebd-4151-a4b5-39c358be044d-delete_volume" released by "delete_volume" :: held 4.360s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Flow 'volume_create_manager' (7f0d0426-2d0a-44e3-b01e-1b7a81c22a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67260e8-82fe-47a2-be5f-c69a3cfa0de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67260e8-82fe-47a2-be5f-c69a3cfa0de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1598724722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74a1d62-b3be-4152-93a7-44401706afa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69a8312a1474b58a93d1d16ca717767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:39:08Z,use_quota=True,user_id='af1293b23d954a14abf25a2bc3189589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131f07e3-db16-4213-958d-d1f96dac7408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131f07e3-db16-4213-958d-d1f96dac7408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c6e21d-e862-423a-a4d7-30eb99866091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c6e21d-e862-423a-a4d7-30eb99866091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74a1d62-b3be-4152-93a7-44401706afa4', 'volume_name': 'volume-c74a1d62-b3be-4152-93a7-44401706afa4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3770e635-d1b4-4f00-ba46-4334bfc1e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3770e635-d1b4-4f00-ba46-4334bfc1e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c87c371-9bb7-43df-9a1b-2599ff73e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Volume c74a1d62-b3be-4152-93a7-44401706afa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74a1d62-b3be-4152-93a7-44401706afa4', 'volume_size': 1} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1598724722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74a1d62-b3be-4152-93a7-44401706afa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69a8312a1474b58a93d1d16ca717767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:39:08Z,use_quota=True,user_id='af1293b23d954a14abf25a2bc3189589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Creating volume c74a1d62-b3be-4152-93a7-44401706afa4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:39:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:39:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:08 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 1073741824 Jul 09 16:39:08 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:09 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 1073741824" returned: 0 in 1.379s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:09 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 Jul 09 16:39:09 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:10 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:39:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c87c371-9bb7-43df-9a1b-2599ff73e30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74a1d62-b3be-4152-93a7-44401706afa4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9810b12e-2502-4ae8-b80a-350fe825faeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Volume volume-c74a1d62-b3be-4152-93a7-44401706afa4 (c74a1d62-b3be-4152-93a7-44401706afa4): created successfully Jul 09 16:39:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9810b12e-2502-4ae8-b80a-350fe825faeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Flow 'volume_create_manager' (7f0d0426-2d0a-44e3-b01e-1b7a81c22a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:39:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c1de7fa5-0845-4f07-87a6-f105ff284819 tempest-VolumeQuotasAdminTestJSON-1293784763 None] Created volume successfully. Jul 09 16:39:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a2ea6e73-39d9-42e7-86a9-92e87201c3c4 tempest-VolumeQuotasAdminTestJSON-1431360402 None] Transfer volume completed successfully. Jul 09 16:39:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Acquiring lock "cinder-c74a1d62-b3be-4152-93a7-44401706afa4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Lock "cinder-c74a1d62-b3be-4152-93a7-44401706afa4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Acquiring lock "cinder-quobyte-c74a1d62-b3be-4152-93a7-44401706afa4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Lock "cinder-quobyte-c74a1d62-b3be-4152-93a7-44401706afa4" acquired by "delete_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bac0f2-4883-4045-a647-1019f711363b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:13 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 Jul 09 16:39:13 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:15 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4" returned: 0 in 1.643s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:15 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4 Jul 09 16:39:15 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:16 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c74a1d62-b3be-4152-93a7-44401706afa4" returned: 0 in 1.265s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Lock "cinder-quobyte-c74a1d62-b3be-4152-93a7-44401706afa4" released by "delete_volume" :: held 2.987s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Created reservations ['f475fa28-83f2-4893-85c4-9f575783ad2f', '803f7b55-5452-4a09-ade4-e852b0117785', 'e5edcb57-f972-425c-a508-7cf6f9c929b0', '6ede196b-0602-438e-bc80-fb83466e48f0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:16 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:39:16 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Acquiring lock "cinder-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "cinder-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Acquiring lock "cinder-quobyte-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "cinder-quobyte-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045" acquired by "delete_volume" :: waited 0.058s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e7294-4dd6-4529-90cb-e3e1d8a5e2ea]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd61ed72-5dd8-46b1-a55b-90eb07881e1c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:17 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 Jul 09 16:39:17 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:17 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:39:17 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:18 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.628s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:39:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Deleted volume successfully. Jul 09 16:39:18 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045" returned: 0 in 1.168s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a9cc8cef-a924-4225-8639-ac0ec0b4b88c tempest-VolumeQuotasAdminTestJSON-252274311 None] Lock "cinder-c74a1d62-b3be-4152-93a7-44401706afa4-delete_volume" released by "delete_volume" :: held 5.024s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:18 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045 Jul 09 16:39:18 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:18 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 1.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564220b-fc29-4f74-b63f-9b27419b0d94]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:19 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "cinder-quobyte-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045" released by "delete_volume" :: held 2.040s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:19 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:39:19 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Created reservations ['08e3e333-d45a-4967-8c72-bfe0ac76df35', '05919f15-521a-4064-8556-a1ce8476002e', '77150d68-ff6e-4b90-9dd0-74d8c5348a8b', 'd6439a58-6761-4989-a94b-641f6ed54c0c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:19 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:39:19 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:20 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 1.281s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.9eeb017a-cbf8-4a12-90fb-832b7514a6da86oylmtv.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:20 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.9eeb017a-cbf8-4a12-90fb-832b7514a6da86oylmtv.img Jul 09 16:39:20 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:20 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.086s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:20 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:39:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Deleted volume successfully. Jul 09 16:39:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-66853495-96e3-429f-a706-e563c7f701bf tempest-AttachVolumeShelveTestJSON-50653402 None] Lock "cinder-fe2071d4-a0e6-4ee6-8e9f-1a60bdfee045-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:26 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.9eeb017a-cbf8-4a12-90fb-832b7514a6da86oylmtv.img" returned: 0 in 6.543s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[01239d21-ef5d-4525-bf80-a1c7018f8d11]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:26 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:39:26 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:27 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 1.094s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:27 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.9eeb017a-cbf8-4a12-90fb-832b7514a6da86oylmtv.img {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:39:27 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Converted 1024.00 MB image at 156.47 MB/s Jul 09 16:39:27 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] 9eeb017a-cbf8-4a12-90fb-832b7514a6da was raw, no need to convert to raw {{(pid=87204) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=74,cinder:UPDATE=78,cinder:INSERT=26,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:28 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:39:28 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:29 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:39:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:39:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Flow 'volume_create_manager' (631d0b5c-592c-49d2-b693-f5909135a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab23ccc-8c1f-4e5b-9ecb-d08d4adfac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab23ccc-8c1f-4e5b-9ecb-d08d4adfac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1651471619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6e4985-99f1-41ea-a5fe-11da61295ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d40557884454a3a859cec29030e9d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:39:31Z,use_quota=True,user_id='b5d7507ecd194b268bcbe129d614ab06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d65285-0ffe-43ce-85eb-764ebdcc822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d65285-0ffe-43ce-85eb-764ebdcc822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2b6bf7-93c3-4037-8164-26191e8ab43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2b6bf7-93c3-4037-8164-26191e8ab43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6e4985-99f1-41ea-a5fe-11da61295ef4', 'volume_name': 'volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b27213-31ed-4bd1-856b-5d2ec2dae5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b27213-31ed-4bd1-856b-5d2ec2dae5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7e5164-db6e-4642-919b-6128b99274de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Volume ac6e4985-99f1-41ea-a5fe-11da61295ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4', 'volume_size': 1} Jul 09 16:39:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:36 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=55,cinder:DELETE=7,cinder:UPDATE=47,cinder:INSERT=13 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:39:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-b2000c1d-1ec6-4e5e-be87-ff01ab35c468 req-4e49196a-1126-4b00-a4e1-0fea8dc345d9 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:46 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.498s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Uploaded volume to glance image-id: 9eeb017a-cbf8-4a12-90fb-832b7514a6da. {{(pid=87204) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.953s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1651471619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6e4985-99f1-41ea-a5fe-11da61295ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d40557884454a3a859cec29030e9d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:39:31Z,use_quota=True,user_id='b5d7507ecd194b268bcbe129d614ab06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Creating volume ac6e4985-99f1-41ea-a5fe-11da61295ef4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:39:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:39:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:50 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 1073741824 Jul 09 16:39:50 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0bb02aee-12f7-4e19-a42b-9751e1c23792 tempest-VolumesActionsTest-782127227 None] Copy volume to image completed successfully. Jul 09 16:39:51 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 1073741824" returned: 0 in 0.913s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:51 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 Jul 09 16:39:51 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:52 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-b2000c1d-1ec6-4e5e-be87-ff01ab35c468 req-4e49196a-1126-4b00-a4e1-0fea8dc345d9 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.045s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7e5164-db6e-4642-919b-6128b99274de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ff26b2-c4c1-4969-9a24-e35541d56df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5825ac-568e-4014-8d38-f0e1fc1e68e5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-b2000c1d-1ec6-4e5e-be87-ff01ab35c468 req-4e49196a-1126-4b00-a4e1-0fea8dc345d9 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Volume volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 (ac6e4985-99f1-41ea-a5fe-11da61295ef4): created successfully Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ff26b2-c4c1-4969-9a24-e35541d56df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:39:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Flow 'volume_create_manager' (631d0b5c-592c-49d2-b693-f5909135a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:39:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d84f53ff-fd6f-41ed-a826-e94d948cef52 tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Created volume successfully. Jul 09 16:39:52 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb Jul 09 16:39:52 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:53 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-b2000c1d-1ec6-4e5e-be87-ff01ab35c468 req-4e49196a-1126-4b00-a4e1-0fea8dc345d9 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-b2000c1d-1ec6-4e5e-be87-ff01ab35c468 req-4e49196a-1126-4b00-a4e1-0fea8dc345d9 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.482s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9983a950-9267-4070-837a-0b6a65bc2b95]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-b2000c1d-1ec6-4e5e-be87-ff01ab35c468 req-4e49196a-1126-4b00-a4e1-0fea8dc345d9 tempest-TestInstancesWithCinderVolumes-1985949941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b8be435-e599-448d-aa83-e5e99879aa61', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:39:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-b2000c1d-1ec6-4e5e-be87-ff01ab35c468 req-4e49196a-1126-4b00-a4e1-0fea8dc345d9 tempest-TestInstancesWithCinderVolumes-1985949941 None] attachment_update completed successfully. Jul 09 16:39:53 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:39:53 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:54 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 1.001s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[050aaac3-0cd2-4f3f-8e3b-1e22df5e559d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Acquiring lock "cinder-ac6e4985-99f1-41ea-a5fe-11da61295ef4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "cinder-ac6e4985-99f1-41ea-a5fe-11da61295ef4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:54 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:39:54 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Acquiring lock "cinder-quobyte-ac6e4985-99f1-41ea-a5fe-11da61295ef4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "cinder-quobyte-ac6e4985-99f1-41ea-a5fe-11da61295ef4" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e82c07c-1745-45ec-8d20-67aa25bdb62c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:54 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 Jul 09 16:39:54 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:54 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:55 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img Jul 09 16:39:55 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:55 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:55 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4 Jul 09 16:39:55 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:56 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ac6e4985-99f1-41ea-a5fe-11da61295ef4" returned: 0 in 1.013s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "cinder-quobyte-ac6e4985-99f1-41ea-a5fe-11da61295ef4" released by "delete_volume" :: held 1.894s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Created reservations ['2ba2530b-de40-4f96-bc72-8003c0676f4e', '839bd6f8-f468-462d-9313-f95e65f24a5b', 'e8a2b031-d9b1-4c10-8d9d-11ada4ad8412', '1e3e255b-1545-4fd3-a1f4-8ce916fb37a9'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:39:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:39:56 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:39:56 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:39:57 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Jul 09 16:39:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.301s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:39:57 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:39:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Deleted volume successfully. Jul 09 16:39:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7956c067-1afc-4d57-bd06-227db55d3ecd tempest-VolumeQuotasNegativeTestJSON-1658875365 None] Lock "cinder-ac6e4985-99f1-41ea-a5fe-11da61295ef4-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:02 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img" returned: 0 in 7.280s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd58aa0-ec06-4cfb-ba88-7e8aff66077e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:02 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:40:02 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-979bab36-278d-4a74-b2d7-db58faf377ea req-8d718c6e-8527-40c3-9a54-213da6b73a19 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:03 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 1.312s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:03 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:40:03 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Converted 1024.00 MB image at 140.64 MB/s Jul 09 16:40:03 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] e0dfe52c-9d8b-4246-9ecb-436dfe585fe2 was raw, converting to qcow2 {{(pid=87204) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 16:40:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b90a629-050c-49d8-bb01-889fd1a873ed]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:03 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img Jul 09 16:40:03 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:04 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img" returned: 0 in 0.955s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:04 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img Jul 09 16:40:04 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:05 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img" returned: 1 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:40:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img /opt/stack/data/cinder/conversion/vol_upload_y1evy6ay {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:05 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img /opt/stack/data/cinder/conversion/vol_upload_y1evy6ay Jul 09 16:40:05 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:06 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img /opt/stack/data/cinder/conversion/vol_upload_y1evy6ay" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:06 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Image conversion details: src /opt/stack/data/cinder/conversion/69932682-e9d0-4f89-9aea-cfe45d048a3c.temp_image.e0dfe52c-9d8b-4246-9ecb-436dfe585fe2nwwtkdgs.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_y1evy6ay {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:40:06 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 16:40:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c5495a-da96-4053-aab2-b5c75ba3fce8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y1evy6ay {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:06 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y1evy6ay Jul 09 16:40:06 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:06 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:40:06 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_y1evy6ay" returned: 0 in 0.752s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Flow 'volume_create_manager' (0672fec0-8d2e-4c4b-a739-6386a7fafc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535385e4-4956-4e9a-bb4e-17cf8cb3ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535385e4-4956-4e9a-bb4e-17cf8cb3ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1969100556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26673c42-d48d-4235-b43b-81cbb11bb001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c6d16a7b7946feaeade6ba203f38d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:08Z,use_quota=True,user_id='35e7ff19559943649d47846893d94bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d566a088-ac61-4cf4-9615-40c65d31997f),volume_type_id=d566a088-ac61-4cf4-9615-40c65d31997f)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a330b-e6fb-458a-ac7a-544479cfbcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9a330b-e6fb-458a-ac7a-544479cfbcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b26de6-f11c-4965-ab35-121e2969cd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b26de6-f11c-4965-ab35-121e2969cd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26673c42-d48d-4235-b43b-81cbb11bb001', 'volume_name': 'volume-26673c42-d48d-4235-b43b-81cbb11bb001', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd47d485-d75c-42dc-a3da-9968549c1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd47d485-d75c-42dc-a3da-9968549c1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4297dc3c-0339-4902-aa68-3dff88805a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Volume 26673c42-d48d-4235-b43b-81cbb11bb001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26673c42-d48d-4235-b43b-81cbb11bb001', 'volume_size': 1} Jul 09 16:40:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.401s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Uploaded volume to glance image-id: e0dfe52c-9d8b-4246-9ecb-436dfe585fe2. {{(pid=87204) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 16:40:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-979bab36-278d-4a74-b2d7-db58faf377ea req-8d718c6e-8527-40c3-9a54-213da6b73a19 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.125s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a57efb9-000e-4e28-aef4-11d1050699fc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-979bab36-278d-4a74-b2d7-db58faf377ea req-8d718c6e-8527-40c3-9a54-213da6b73a19 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6b4b8d7a-d0dd-46dc-8c3a-02e5ae767ef9 tempest-VolumesActionsTest-782127227 None] Copy volume to image completed successfully. Jul 09 16:40:08 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 Jul 09 16:40:08 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:09 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-979bab36-278d-4a74-b2d7-db58faf377ea req-8d718c6e-8527-40c3-9a54-213da6b73a19 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8" returned: 0 in 0.846s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-979bab36-278d-4a74-b2d7-db58faf377ea req-8d718c6e-8527-40c3-9a54-213da6b73a19 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1969100556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26673c42-d48d-4235-b43b-81cbb11bb001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c6d16a7b7946feaeade6ba203f38d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:08Z,use_quota=True,user_id='35e7ff19559943649d47846893d94bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d566a088-ac61-4cf4-9615-40c65d31997f),volume_type_id=d566a088-ac61-4cf4-9615-40c65d31997f)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Creating volume 26673c42-d48d-4235-b43b-81cbb11bb001 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:40:09 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:09 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 1073741824 Jul 09 16:40:09 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-979bab36-278d-4a74-b2d7-db58faf377ea req-8d718c6e-8527-40c3-9a54-213da6b73a19 tempest-TestInstancesWithCinderVolumes-1985949941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67ae41aa-245b-45ef-8e6d-60d7dcb226cf', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Acquiring lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-979bab36-278d-4a74-b2d7-db58faf377ea req-8d718c6e-8527-40c3-9a54-213da6b73a19 tempest-TestInstancesWithCinderVolumes-1985949941 None] attachment_update completed successfully. Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Acquiring lock "cinder-quobyte-69932682-e9d0-4f89-9aea-cfe45d048a3c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Lock "cinder-quobyte-69932682-e9d0-4f89-9aea-cfe45d048a3c" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a54a184-d1bc-433e-945d-1d842d0c525f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:09 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:40:09 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:10 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 1073741824" returned: 0 in 1.184s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:10 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 Jul 09 16:40:10 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:10 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 1.041s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:10 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c Jul 09 16:40:10 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:11 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4297dc3c-0339-4902-aa68-3dff88805a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26673c42-d48d-4235-b43b-81cbb11bb001', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2329dadd-7149-4c6a-a60d-60abefa4be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:11 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Volume volume-26673c42-d48d-4235-b43b-81cbb11bb001 (26673c42-d48d-4235-b43b-81cbb11bb001): created successfully Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2329dadd-7149-4c6a-a60d-60abefa4be1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Flow 'volume_create_manager' (0672fec0-8d2e-4c4b-a739-6386a7fafc4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-451d29e7-fca2-4bef-a574-0f198954a678 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Created volume successfully. Jul 09 16:40:11 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-69932682-e9d0-4f89-9aea-cfe45d048a3c" returned: 0 in 0.719s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Lock "cinder-quobyte-69932682-e9d0-4f89-9aea-cfe45d048a3c" released by "delete_volume" :: held 1.844s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Created reservations ['9b415963-6adb-4f77-a411-721dca4accaf', 'ebb12da7-e141-49b9-8300-93b51f37161f', '14536aea-248f-474a-9ee0-d080b4e3a0e3', 'a03a8423-448c-4d51-a70a-4dac099b5d49'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:11 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:11 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:12 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Deleted volume successfully. Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e7c68d5-4b0a-44df-91c1-6235da216dfd tempest-VolumesActionsTest-782127227 None] Lock "cinder-69932682-e9d0-4f89-9aea-cfe45d048a3c-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:12 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:12 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:13 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8bc6b557-f846-4724-a04e-2f9a62e88773 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Retype volume completed successfully. Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Acquiring lock "cinder-26673c42-d48d-4235-b43b-81cbb11bb001-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "cinder-26673c42-d48d-4235-b43b-81cbb11bb001-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Acquiring lock "cinder-quobyte-26673c42-d48d-4235-b43b-81cbb11bb001" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "cinder-quobyte-26673c42-d48d-4235-b43b-81cbb11bb001" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[44142b51-49bd-4275-a425-aeccdfcb3203]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:14 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 Jul 09 16:40:14 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:14 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001" returned: 0 in 0.958s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:14 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001 Jul 09 16:40:14 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:15 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-26673c42-d48d-4235-b43b-81cbb11bb001" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "cinder-quobyte-26673c42-d48d-4235-b43b-81cbb11bb001" released by "delete_volume" :: held 1.786s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:15 devstack cinder-volume[87204]: WARNING cinder.quota [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:15 devstack cinder-volume[87204]: WARNING cinder.quota [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:15 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Created reservations ['adc04caa-f35e-4196-a053-3a1b489b7bb1', 'ec26eba6-c237-43e4-a5f4-04343b2be6f4', 'b4072cb2-3c44-43ac-be9c-a87c37aa2ea7', '932fd0d0-6fbf-463f-96f4-5ec57062e3b7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:16 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:16 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:16 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Deleted volume successfully. Jul 09 16:40:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4f3d50f4-d025-472a-beb6-f6815b966892 tempest-VolumeRetypeWithoutMigrationTest-871537149 None] Lock "cinder-26673c42-d48d-4235-b43b-81cbb11bb001-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Flow 'volume_create_manager' (48f08757-7c2c-4d43-b038-bcedcaea26cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dee0dc5-1442-42a4-adf2-c7f8351cd48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dee0dc5-1442-42a4-adf2-c7f8351cd48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-509136922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf16e04b-eef9-48e3-bd84-dd0003c253a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549934964746477189b6e49d2f44a54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:19Z,use_quota=True,user_id='a149a578b7de48fc8e5859d6410bd38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2e0131-2fb5-4e05-9fcb-faa06dd68fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2e0131-2fb5-4e05-9fcb-faa06dd68fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54046d36-7b35-4c88-9da8-dc315dabe865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54046d36-7b35-4c88-9da8-dc315dabe865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf16e04b-eef9-48e3-bd84-dd0003c253a1', 'volume_name': 'volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4ff7f9-a799-493a-a7e1-33608342f571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4ff7f9-a799-493a-a7e1-33608342f571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff011b4f-dbda-42ca-95ac-62b0d5d2454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Volume bf16e04b-eef9-48e3-bd84-dd0003c253a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1', 'volume_size': 1} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-509136922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf16e04b-eef9-48e3-bd84-dd0003c253a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549934964746477189b6e49d2f44a54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:19Z,use_quota=True,user_id='a149a578b7de48fc8e5859d6410bd38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Creating volume bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:40:18 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:40:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:19 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 1073741824 Jul 09 16:40:19 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-4389c892-92d5-4882-8d95-6fc4b94ef73a req-ddd930b4-b05f-4625-b897-a942d684a12a tempest-TestInstancesWithCinderVolumes-1985949941 None] Terminate volume connection completed successfully. Jul 09 16:40:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-4389c892-92d5-4882-8d95-6fc4b94ef73a req-ddd930b4-b05f-4625-b897-a942d684a12a tempest-TestInstancesWithCinderVolumes-1985949941 None] Deleting attachment 0b8be435-e599-448d-aa83-e5e99879aa61. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:40:19 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 1073741824" returned: 0 in 0.993s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:20 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 Jul 09 16:40:20 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:20 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1" returned: 0 in 0.664s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff011b4f-dbda-42ca-95ac-62b0d5d2454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296cf02-d4f1-4ac1-bdb5-d9b8372519b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Volume volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 (bf16e04b-eef9-48e3-bd84-dd0003c253a1): created successfully Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296cf02-d4f1-4ac1-bdb5-d9b8372519b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Flow 'volume_create_manager' (48f08757-7c2c-4d43-b038-bcedcaea26cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-04d4ad66-6f31-49d8-8564-912b31caef39 tempest-VolumesCloneTest-662341294 None] Created volume successfully. Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Flow 'volume_create_manager' (d7a0ea64-f8f9-46bc-978f-201d4f685e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c033ab-fa28-49d9-bd6d-9c6509b88490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c033ab-fa28-49d9-bd6d-9c6509b88490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2134842793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c02007-efbc-4216-ad0e-264a817f73fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549934964746477189b6e49d2f44a54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bf16e04b-eef9-48e3-bd84-dd0003c253a1,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:21Z,use_quota=True,user_id='a149a578b7de48fc8e5859d6410bd38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad47b2ec-dc82-4cdf-b49d-33944ca8a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad47b2ec-dc82-4cdf-b49d-33944ca8a959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ffc9cd-d03e-4bdd-b767-c41d042aeee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ffc9cd-d03e-4bdd-b767-c41d042aeee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '02c02007-efbc-4216-ad0e-264a817f73fd', 'volume_name': 'volume-02c02007-efbc-4216-ad0e-264a817f73fd', 'volume_size': 2, 'source_volid': 'bf16e04b-eef9-48e3-bd84-dd0003c253a1', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b99a8ef-1595-4017-8a01-e53435aab666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b99a8ef-1595-4017-8a01-e53435aab666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6eefdf4-6d41-4cd9-90ff-440f4529790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Volume 02c02007-efbc-4216-ad0e-264a817f73fd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-02c02007-efbc-4216-ad0e-264a817f73fd', 'volume_size': 2, 'source_volid': 'bf16e04b-eef9-48e3-bd84-dd0003c253a1', 'source_volstatus': 'available'} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Cloning volume bf16e04b-eef9-48e3-bd84-dd0003c253a1 to volume 02c02007-efbc-4216-ad0e-264a817f73fd Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Creating offline snapshot 31d6ce3d-3a09-4637-be73-404eb2ea6746 of volume bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bbd964-9837-4fdf-a6b5-cc24b2fed018]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:21 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "cinder-efefa232-efc2-4f75-a7e8-f2ab96eceacb-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:21 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-efefa232-efc2-4f75-a7e8-f2ab96eceacb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "cinder-quobyte-efefa232-efc2-4f75-a7e8-f2ab96eceacb" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-quobyte-efefa232-efc2-4f75-a7e8-f2ab96eceacb" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[19996d81-4ba0-4052-a3d6-a29ce4b5147c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:22 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb Jul 09 16:40:22 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:22 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1" returned: 0 in 0.992s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:22 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 1G Jul 09 16:40:22 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Flow 'volume_create_manager' (bcf983fc-aee3-4e11-9a50-534298f06ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4ea574-6119-4bf0-ac2a-20ed81175f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4ea574-6119-4bf0-ac2a-20ed81175f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-270048133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fd8e79-6a6d-42da-93fa-5c9c33768e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df14f32a1e44587b74097453ff55de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:23Z,use_quota=True,user_id='e4d7c630694248edb138d0c06381e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cd4a70-8de7-4c1a-86aa-f946b46b6440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cd4a70-8de7-4c1a-86aa-f946b46b6440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10217c7b-e2e1-4888-a24a-ac3d595c31af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10217c7b-e2e1-4888-a24a-ac3d595c31af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47fd8e79-6a6d-42da-93fa-5c9c33768e8b', 'volume_name': 'volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b123b6-7cb9-418c-9aba-b8d202816caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b123b6-7cb9-418c-9aba-b8d202816caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2280b11-9e13-4340-a4a0-c37f2b6a4e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Volume 47fd8e79-6a6d-42da-93fa-5c9c33768e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b', 'volume_size': 1} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:23 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb" returned: 0 in 1.255s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:23 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb Jul 09 16:40:23 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:23 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 1G" returned: 0 in 1.083s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:23 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 Jul 09 16:40:23 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:24 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-efefa232-efc2-4f75-a7e8-f2ab96eceacb" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-quobyte-efefa232-efc2-4f75-a7e8-f2ab96eceacb" released by "delete_volume" :: held 2.105s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:24 devstack cinder-volume[87204]: WARNING cinder.quota [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1835208409-35372516 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1835208409-35372516, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:24 devstack cinder-volume[87204]: WARNING cinder.quota [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1835208409-35372516 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1835208409-35372516, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Created reservations ['8ff3f592-e489-4bd9-a1b0-73e9bac3d454', '2eb97ba6-5de1-48cd-989b-2ce819bfe0b3', 'bb47b6cc-0098-4e7e-992f-e71802c0291a', 'd88c7041-e283-4eba-b378-1ae5f96f1076'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:24 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:24 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:24 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:24 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 is being set with open permissions: ugo+rw Jul 09 16:40:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:24 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 Jul 09 16:40:24 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:24 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deleted volume successfully. Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d8c4a825-61f5-46d6-909b-8e7f8ac1f992 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-efefa232-efc2-4f75-a7e8-f2ab96eceacb-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:25 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:25 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.info Jul 09 16:40:25 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Flow 'volume_create_manager' (fe13febe-8e1e-4f71-9cad-4a0949e73765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e090b1-a6bf-4cc9-a49d-1781a7a79aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e090b1-a6bf-4cc9-a49d-1781a7a79aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1953355839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb87461d-17f9-422e-a5c2-b0707ae797cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846071918c414d82b8aa5f52c51db66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:26Z,use_quota=True,user_id='41f2d74f7a8043adb12e1895ee4f8282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54d393a-b90b-41fa-a0b0-d00310d9738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54d393a-b90b-41fa-a0b0-d00310d9738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c61e650-900a-4851-b77a-05ce4b304a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c61e650-900a-4851-b77a-05ce4b304a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb87461d-17f9-422e-a5c2-b0707ae797cd', 'volume_name': 'volume-cb87461d-17f9-422e-a5c2-b0707ae797cd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6bbb9d-9c04-4e86-a74b-af01dbfdfe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6bbb9d-9c04-4e86-a74b-af01dbfdfe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47097228-860d-4396-a041-fba94a236ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Volume cb87461d-17f9-422e-a5c2-b0707ae797cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb87461d-17f9-422e-a5c2-b0707ae797cd', 'volume_size': 1} Jul 09 16:40:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:26 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.info" returned: 0 in 0.695s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.info is being set with open permissions: ugo+rw Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:26 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.info Jul 09 16:40:26 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:26 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.info" returned: 0 in 0.642s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Acquiring lock "cinder-quobyte-02c02007-efbc-4216-ad0e-264a817f73fd" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-02c02007-efbc-4216-ad0e-264a817f73fd" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] snapshot: 31d6ce3d-3a09-4637-be73-404eb2ea6746, volume: 02c02007-efbc-4216-ad0e-264a817f73fd, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd509e-457b-4f4d-ab73-a017e212b32d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:26 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 Jul 09 16:40:26 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-90c4eafb-7446-4c92-90a6-cf83a7feec0b req-ba72ea8b-bf64-401f-9b6d-b7d19dbdd288 tempest-TestInstancesWithCinderVolumes-1985949941 None] Terminate volume connection completed successfully. Jul 09 16:40:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-90c4eafb-7446-4c92-90a6-cf83a7feec0b req-ba72ea8b-bf64-401f-9b6d-b7d19dbdd288 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deleting attachment 67ae41aa-245b-45ef-8e6d-60d7dcb226cf. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:40:27 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746" returned: 0 in 0.758s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:40:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:40:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:40:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeac23c-cceb-4f7d-bd2d-f0b41d94852c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:27 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 Jul 09 16:40:27 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:28 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:28 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd Jul 09 16:40:28 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:28 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:28 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "cinder-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "cinder-quobyte-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-quobyte-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8" acquired by "delete_volume" :: waited 0.052s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda0665-0711-4085-a86a-f3bf6077a111]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:29 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 Jul 09 16:40:29 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:30 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.635s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:30 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:30 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:40:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:40:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:40:31 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8" returned: 0 in 2.008s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:31 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8 Jul 09 16:40:31 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:33 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8" returned: 0 in 1.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-quobyte-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8" released by "delete_volume" :: held 3.895s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:33 devstack cinder-volume[87204]: WARNING cinder.quota [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856961887-2025579702 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856961887-2025579702, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:33 devstack cinder-volume[87204]: WARNING cinder.quota [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856961887-2025579702 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1856961887-2025579702, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Created reservations ['76efc84f-1dea-4763-856d-64b5d28f6895', 'c81afee3-d819-4bf7-8502-ed8f97bdcdba', 'ba9f8b63-6573-4bdd-98bc-aa53e0456fce', '291163e5-2106-467e-88ef-b247d898de99'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:33 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:33 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:34 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd" returned: 0 in 6.168s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[93246f9e-0257-4354-ab68-eb69a6cff9ff]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:34 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 Jul 09 16:40:34 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:34 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.343s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:34 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Deleted volume successfully. Jul 09 16:40:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-221c7923-c179-41fb-8873-aa6967e95d0b tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-ff52e8a7-f40f-41e6-81c2-10ce042ad3e8-delete_volume" released by "delete_volume" :: held 5.708s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:35 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1" returned: 0 in 1.090s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:35 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:40:35 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Converted 1024.00 MB image at 165.97 MB/s Jul 09 16:40:35 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd is being set with open permissions: ugo+rw Jul 09 16:40:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:35 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd Jul 09 16:40:35 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:36 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-02c02007-efbc-4216-ad0e-264a817f73fd" released by "_copy_volume_from_snapshot" :: held 9.568s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Acquiring lock "cinder-quobyte-31d6ce3d-3a09-4637-be73-404eb2ea6746" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-31d6ce3d-3a09-4637-be73-404eb2ea6746" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Deleting offline snapshot 31d6ce3d-3a09-4637-be73-404eb2ea6746 of volume bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] snapshot_file for this snap is: volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf821db-4809-4281-bda0-01c99fe7a7f3]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:36 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 Jul 09 16:40:36 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:37 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746" returned: 0 in 0.910s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:40:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5a88a4-f234-415d-be07-139c2eff45a7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:37 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 Jul 09 16:40:37 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:38 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:38 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 Jul 09 16:40:38 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:38 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746" returned: 0 in 0.780s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:38 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746 Jul 09 16:40:38 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-6104c386-de1b-4147-a85c-3d83545b09b9 req-1faaa15b-5757-4f70-9136-0f99ed71ae32 tempest-TestInstancesWithCinderVolumes-1985949941 None] Terminate volume connection completed successfully. Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-6104c386-de1b-4147-a85c-3d83545b09b9 req-1faaa15b-5757-4f70-9136-0f99ed71ae32 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deleting attachment 3406d329-6c3a-4e8e-b450-6c3609f1b136. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:40:39 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1.31d6ce3d-3a09-4637-be73-404eb2ea6746" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-31d6ce3d-3a09-4637-be73-404eb2ea6746" released by "_delete_snapshot" :: held 3.260s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.966s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.411s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-270048133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fd8e79-6a6d-42da-93fa-5c9c33768e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df14f32a1e44587b74097453ff55de5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:23Z,use_quota=True,user_id='e4d7c630694248edb138d0c06381e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Creating volume 47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:40:39 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6eefdf4-6d41-4cd9-90ff-440f4529790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c02007-efbc-4216-ad0e-264a817f73fd', 'volume_size': 2, 'source_volid': 'bf16e04b-eef9-48e3-bd84-dd0003c253a1', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:39 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b 1073741824 Jul 09 16:40:39 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f444864-068a-4778-bec0-3b4646e587d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Volume volume-02c02007-efbc-4216-ad0e-264a817f73fd (02c02007-efbc-4216-ad0e-264a817f73fd): created successfully Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f444864-068a-4778-bec0-3b4646e587d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Flow 'volume_create_manager' (d7a0ea64-f8f9-46bc-978f-201d4f685e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-92803656-1d34-41fd-b202-5f159fb3d298 tempest-VolumesCloneTest-662341294 None] Created volume successfully. Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Acquiring lock "cinder-02c02007-efbc-4216-ad0e-264a817f73fd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Lock "cinder-02c02007-efbc-4216-ad0e-264a817f73fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Acquiring lock "cinder-quobyte-02c02007-efbc-4216-ad0e-264a817f73fd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-02c02007-efbc-4216-ad0e-264a817f73fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9f128-5c3c-443b-82ac-c3686e4fba5b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:40 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b 1073741824" returned: 0 in 0.929s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:40 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd Jul 09 16:40:40 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:40 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b Jul 09 16:40:40 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:41 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" returned: 0 in 0.654s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.396s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1953355839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb87461d-17f9-422e-a5c2-b0707ae797cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846071918c414d82b8aa5f52c51db66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:26Z,use_quota=True,user_id='41f2d74f7a8043adb12e1895ee4f8282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Creating volume cb87461d-17f9-422e-a5c2-b0707ae797cd {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:40:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:41 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd" returned: 0 in 0.809s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:41 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd 1073741824 Jul 09 16:40:41 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2280b11-9e13-4340-a4a0-c37f2b6a4e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb21e820-3a48-4a71-854d-cc6389b709f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:41 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd Jul 09 16:40:41 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Volume volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b (47fd8e79-6a6d-42da-93fa-5c9c33768e8b): created successfully Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb21e820-3a48-4a71-854d-cc6389b709f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Flow 'volume_create_manager' (bcf983fc-aee3-4e11-9a50-534298f06ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d53b8104-e709-4573-90cb-0222ff1e4d1d tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Created volume successfully. Jul 09 16:40:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:42 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-02c02007-efbc-4216-ad0e-264a817f73fd" returned: 0 in 0.724s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-02c02007-efbc-4216-ad0e-264a817f73fd" released by "delete_volume" :: held 1.588s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Created reservations ['1881962c-7598-47cd-90fa-05f1bc9dc7de', 'ae869895-2c7d-46ff-8675-c3422f84e446', '4e4fd575-58dd-4b3b-bea4-24043df275e7', '2f3f3a8e-9ddc-4c5b-9aa0-23e56264ddad'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:42 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd 1073741824" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:42 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:42 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:42 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd Jul 09 16:40:42 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "cinder-ee46a6ef-9a27-450c-b41f-47268b85f5ea-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-ee46a6ef-9a27-450c-b41f-47268b85f5ea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "cinder-quobyte-ee46a6ef-9a27-450c-b41f-47268b85f5ea" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-quobyte-ee46a6ef-9a27-450c-b41f-47268b85f5ea" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6661cd-abc3-4f2a-ae14-7e569eb9416c]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Acquiring lock "cinder-bf16e04b-eef9-48e3-bd84-dd0003c253a1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Lock "cinder-bf16e04b-eef9-48e3-bd84-dd0003c253a1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:42 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:40:42 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Acquiring lock "cinder-quobyte-bf16e04b-eef9-48e3-bd84-dd0003c253a1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-bf16e04b-eef9-48e3-bd84-dd0003c253a1" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3f2d60-bbab-4eee-82ba-f33189553959]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:42 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Deleted volume successfully. Jul 09 16:40:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9b3b122d-932b-4bfd-94b1-ad825c25eb4d tempest-VolumesCloneTest-662341294 None] Lock "cinder-02c02007-efbc-4216-ad0e-264a817f73fd-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:43 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd" returned: 0 in 0.834s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.129s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47097228-860d-4396-a041-fba94a236ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb87461d-17f9-422e-a5c2-b0707ae797cd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4eb9b55-d5e8-4d95-99d7-85873c041a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Creating offline snapshot ffa61aec-79cb-4c5d-be1d-ff3c99734463 of volume 47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:40:43 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 Jul 09 16:40:43 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Volume volume-cb87461d-17f9-422e-a5c2-b0707ae797cd (cb87461d-17f9-422e-a5c2-b0707ae797cd): created successfully Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4eb9b55-d5e8-4d95-99d7-85873c041a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Flow 'volume_create_manager' (fe13febe-8e1e-4f71-9cad-4a0949e73765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[19323960-42e9-49f0-a5d7-5c693b9919bc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-25015671-bd5c-4f57-a244-c7ff23dc8cb3 tempest-AttachVolumeTestJSON-1630178730 None] Created volume successfully. Jul 09 16:40:43 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b Jul 09 16:40:43 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:43 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 0 in 0.919s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:43 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:40:43 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:43 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:43 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1 Jul 09 16:40:43 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:43 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:43 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 1G Jul 09 16:40:43 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:44 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 1 in 0.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:44 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea Jul 09 16:40:44 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:44 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bf16e04b-eef9-48e3-bd84-dd0003c253a1" returned: 0 in 0.701s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Lock "cinder-quobyte-bf16e04b-eef9-48e3-bd84-dd0003c253a1" released by "delete_volume" :: held 1.695s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Created reservations ['487e0bb7-f636-406d-a1db-d11d1f0c653d', '5f3c2832-483e-469d-8352-1bfd409de8c7', 'cae57fb7-3f03-4b76-a2c9-1ee0a2461684', '2de7faae-46d1-4b45-a201-1ceb6b77e909'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:44 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:44 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:44 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 1G" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:44 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 Jul 09 16:40:44 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:45 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ee46a6ef-9a27-450c-b41f-47268b85f5ea" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-quobyte-ee46a6ef-9a27-450c-b41f-47268b85f5ea" released by "delete_volume" :: held 2.535s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:45 devstack cinder-volume[87204]: WARNING cinder.quota [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-313598122-1372283449 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-313598122-1372283449, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:45 devstack cinder-volume[87204]: WARNING cinder.quota [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-313598122-1372283449 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-313598122-1372283449, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Created reservations ['8f62715d-718a-488e-a9d3-ec4f2383a207', '5bf15c64-3be9-4902-8853-773455fc0e71', 'e0177f3a-ff03-4734-aa3a-6410df89c95d', '78273f38-c88f-4308-aea5-eda684f87830'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:45 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:45 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:45 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Deleted volume successfully. Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6ebca510-deea-472f-9e05-c73e0c3addee tempest-VolumesCloneTest-662341294 None] Lock "cinder-bf16e04b-eef9-48e3-bd84-dd0003c253a1-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:45 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463" returned: 0 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:45 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 is being set with open permissions: ugo+rw Jul 09 16:40:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:45 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 Jul 09 16:40:45 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:46 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Deleted volume successfully. Jul 09 16:40:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e887c86-e54d-4013-8d67-d79b54acdf65 tempest-TestInstancesWithCinderVolumes-1985949941 None] Lock "cinder-ee46a6ef-9a27-450c-b41f-47268b85f5ea-delete_volume" released by "delete_volume" :: held 3.721s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:46 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463" returned: 0 in 0.820s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:46 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=82,cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:40:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:46 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.info Jul 09 16:40:46 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:47 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.info" returned: 0 in 0.733s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:47 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.info is being set with open permissions: ugo+rw Jul 09 16:40:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:47 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.info Jul 09 16:40:47 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d24c1e3a-4e6b-4362-876c-cfd8c46dda4c req-d8640ec1-e601-414d-8faa-8a79d184b0c0 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:48 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.info" returned: 0 in 0.725s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d24c1e3a-4e6b-4362-876c-cfd8c46dda4c req-d8640ec1-e601-414d-8faa-8a79d184b0c0 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.691s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e151560-7005-41d0-ace2-f6df5fe6d001]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d24c1e3a-4e6b-4362-876c-cfd8c46dda4c req-d8640ec1-e601-414d-8faa-8a79d184b0c0 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a302b003-543b-42df-9774-00ccc4d0f2b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Create snapshot completed successfully Jul 09 16:40:48 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd Jul 09 16:40:48 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Flow 'volume_create_manager' (f07f1907-5ca5-4bf3-b00d-82d27aabf767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5452ee4-2c29-4328-af19-dff8be9826f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5452ee4-2c29-4328-af19-dff8be9826f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-648020407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a9031-de52-4f77-98ed-2cf0ef0995b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81aaac79a5fa46e495bc3896c767f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:48Z,use_quota=True,user_id='23caf178bfbe4b99b7d7eca9c81aae93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d356e9a-6eba-4e5e-9001-1b4285174d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d356e9a-6eba-4e5e-9001-1b4285174d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe4564b-d9cd-41be-a5fb-334d66d863fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe4564b-d9cd-41be-a5fb-334d66d863fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9a9031-de52-4f77-98ed-2cf0ef0995b2', 'volume_name': 'volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e198a109-7d6f-4aa3-9a60-30fb74ba9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e198a109-7d6f-4aa3-9a60-30fb74ba9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbba799e-d5f3-4f65-8431-29d7a9cd75c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Volume 9c9a9031-de52-4f77-98ed-2cf0ef0995b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2', 'volume_size': 1} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "cinder-ffa61aec-79cb-4c5d-be1d-ff3c99734463-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-ffa61aec-79cb-4c5d-be1d-ff3c99734463-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "cinder-quobyte-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-quobyte-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "cinder-quobyte-ffa61aec-79cb-4c5d-be1d-ff3c99734463" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-quobyte-ffa61aec-79cb-4c5d-be1d-ff3c99734463" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Deleting offline snapshot ffa61aec-79cb-4c5d-be1d-ff3c99734463 of volume 47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:40:49 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] snapshot_file for this snap is: volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-d24c1e3a-4e6b-4362-876c-cfd8c46dda4c req-d8640ec1-e601-414d-8faa-8a79d184b0c0 tempest-AttachVolumeTestJSON-1630178730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd" returned: 0 in 0.961s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-d24c1e3a-4e6b-4362-876c-cfd8c46dda4c req-d8640ec1-e601-414d-8faa-8a79d184b0c0 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.989s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-648020407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a9031-de52-4f77-98ed-2cf0ef0995b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81aaac79a5fa46e495bc3896c767f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:48Z,use_quota=True,user_id='23caf178bfbe4b99b7d7eca9c81aae93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Creating volume 9c9a9031-de52-4f77-98ed-2cf0ef0995b2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:40:49 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08f5fe7-cb5f-4a0e-b1e1-fa0563032233]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:49 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 1073741824 Jul 09 16:40:49 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-d24c1e3a-4e6b-4362-876c-cfd8c46dda4c req-d8640ec1-e601-414d-8faa-8a79d184b0c0 tempest-AttachVolumeTestJSON-1630178730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-cb87461d-17f9-422e-a5c2-b0707ae797cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf38f882-05d9-40f8-9a64-65739c895b72', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:40:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-d24c1e3a-4e6b-4362-876c-cfd8c46dda4c req-d8640ec1-e601-414d-8faa-8a79d184b0c0 tempest-AttachVolumeTestJSON-1630178730 None] attachment_update completed successfully. Jul 09 16:40:49 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 Jul 09 16:40:49 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:50 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463" returned: 0 in 0.944s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:40:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc2888c-9062-496b-a86a-b4364800ba23]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:50 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b Jul 09 16:40:50 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:50 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 1073741824" returned: 0 in 1.194s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:50 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 Jul 09 16:40:50 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:51 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" returned: 0 in 0.983s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:51 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 Jul 09 16:40:51 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:51 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2" returned: 0 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbba799e-d5f3-4f65-8431-29d7a9cd75c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73184e1-4254-4799-82c3-6de2deee8c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Volume volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 (9c9a9031-de52-4f77-98ed-2cf0ef0995b2): created successfully Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73184e1-4254-4799-82c3-6de2deee8c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Flow 'volume_create_manager' (f07f1907-5ca5-4bf3-b00d-82d27aabf767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d80d5b0c-a35d-4015-9bdb-bad34674b06f tempest-VolumesListTestJSON-89782055 None] Created volume successfully. Jul 09 16:40:51 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:51 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463 Jul 09 16:40:51 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Flow 'volume_create_manager' (f48df8cc-b0bd-4628-a823-d803d4b28624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60dc7f0-fcda-44a6-957d-9ef126d0acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60dc7f0-fcda-44a6-957d-9ef126d0acd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1552626619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358fa862-7ca2-4883-bede-c96af29297c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81aaac79a5fa46e495bc3896c767f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:52Z,use_quota=True,user_id='23caf178bfbe4b99b7d7eca9c81aae93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd609ea1-a93f-4315-8f5f-cc996abba783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd609ea1-a93f-4315-8f5f-cc996abba783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b07cf09-fae2-4794-b328-840b518538bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b07cf09-fae2-4794-b328-840b518538bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358fa862-7ca2-4883-bede-c96af29297c5', 'volume_name': 'volume-358fa862-7ca2-4883-bede-c96af29297c5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cb9232-0857-43bc-be51-0add86c64dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cb9232-0857-43bc-be51-0add86c64dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cd858f-cfa1-4e07-8d71-6d2815f27536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Volume 358fa862-7ca2-4883-bede-c96af29297c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358fa862-7ca2-4883-bede-c96af29297c5', 'volume_size': 1} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1552626619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358fa862-7ca2-4883-bede-c96af29297c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81aaac79a5fa46e495bc3896c767f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:52Z,use_quota=True,user_id='23caf178bfbe4b99b7d7eca9c81aae93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Creating volume 358fa862-7ca2-4883-bede-c96af29297c5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:40:52 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:52 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 1073741824 Jul 09 16:40:52 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:52 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b.ffa61aec-79cb-4c5d-be1d-ff3c99734463" returned: 0 in 0.793s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-quobyte-ffa61aec-79cb-4c5d-be1d-ff3c99734463" released by "_delete_snapshot" :: held 3.717s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-quobyte-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" released by "delete_snapshot" :: held 3.743s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Created reservations ['1343b216-f302-499f-925a-b97446bce72e', '4241a922-062b-49a2-baa6-6ffdafcf8ef0', 'e2ddc875-40ef-404c-b364-5b1f9ea7df69', 'e83e31bc-8ff8-49c4-ae5b-573568a186cb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Delete snapshot completed successfully. Jul 09 16:40:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-711f0920-0b91-4577-b41e-367e955af012 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-ffa61aec-79cb-4c5d-be1d-ff3c99734463-delete_snapshot" released by "delete_snapshot" :: held 3.924s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "cinder-47fd8e79-6a6d-42da-93fa-5c9c33768e8b-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-47fd8e79-6a6d-42da-93fa-5c9c33768e8b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "cinder-quobyte-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-quobyte-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dfbfdd-feb9-428a-bce1-92e677e61f88]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:53 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 1073741824" returned: 0 in 1.065s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:53 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b Jul 09 16:40:53 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:53 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 Jul 09 16:40:53 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:54 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5" returned: 0 in 0.913s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:54 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cd858f-cfa1-4e07-8d71-6d2815f27536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358fa862-7ca2-4883-bede-c96af29297c5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a77a56-dcfc-48fe-b76f-3c4e9254c006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" returned: 0 in 1.077s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Volume volume-358fa862-7ca2-4883-bede-c96af29297c5 (358fa862-7ca2-4883-bede-c96af29297c5): created successfully Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a77a56-dcfc-48fe-b76f-3c4e9254c006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Flow 'volume_create_manager' (f48df8cc-b0bd-4628-a823-d803d4b28624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:54 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b Jul 09 16:40:54 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a3c3b847-5ecc-4610-afe2-f2849cec848e tempest-VolumesListTestJSON-89782055 None] Created volume successfully. Jul 09 16:40:55 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-quobyte-47fd8e79-6a6d-42da-93fa-5c9c33768e8b" released by "delete_volume" :: held 1.909s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Created reservations ['1da8dc9b-818b-417c-8eee-78dee840bee4', '611d2ebc-f9f1-41f4-bdc2-cff3ccbeba69', '086cb18e-14a5-496b-8400-9cb746835d8c', '25eaff1d-28a1-4659-89c7-605bcc6c3cdd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:55 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:40:55 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Flow 'volume_create_manager' (03748287-30d0-4442-bb0a-8ae420451584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba1bec8-dcf6-42a9-b3ef-0831ce8c2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:56 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba1bec8-dcf6-42a9-b3ef-0831ce8c2b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1050467171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132c6436-b415-4e7d-860f-f9f5baf404e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81aaac79a5fa46e495bc3896c767f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:56Z,use_quota=True,user_id='23caf178bfbe4b99b7d7eca9c81aae93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10dea70-f667-41bd-8a7c-641265c48f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10dea70-f667-41bd-8a7c-641265c48f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2700921-34fd-4816-a6b5-be547b54efa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2700921-34fd-4816-a6b5-be547b54efa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132c6436-b415-4e7d-860f-f9f5baf404e2', 'volume_name': 'volume-132c6436-b415-4e7d-860f-f9f5baf404e2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b2cd73-6252-44be-ba74-641590207504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b2cd73-6252-44be-ba74-641590207504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc10ca20-3d93-41ed-9697-af63d0882eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Volume 132c6436-b415-4e7d-860f-f9f5baf404e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132c6436-b415-4e7d-860f-f9f5baf404e2', 'volume_size': 1} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1050467171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132c6436-b415-4e7d-860f-f9f5baf404e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81aaac79a5fa46e495bc3896c767f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:40:56Z,use_quota=True,user_id='23caf178bfbe4b99b7d7eca9c81aae93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Creating volume 132c6436-b415-4e7d-860f-f9f5baf404e2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:40:56 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.055s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:40:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Deleted volume successfully. Jul 09 16:40:56 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 1073741824 Jul 09 16:40:56 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1f934992-1fd7-4077-9968-9ef9441c46b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1494343319 None] Lock "cinder-47fd8e79-6a6d-42da-93fa-5c9c33768e8b-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:40:57 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 1073741824" returned: 0 in 1.138s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:40:57 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 Jul 09 16:40:57 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:40:58 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 09 16:40:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:40:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:40:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:40:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc10ca20-3d93-41ed-9697-af63d0882eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132c6436-b415-4e7d-860f-f9f5baf404e2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbaa5ba-6c07-4a60-b880-c1c8c73e756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:40:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Volume volume-132c6436-b415-4e7d-860f-f9f5baf404e2 (132c6436-b415-4e7d-860f-f9f5baf404e2): created successfully Jul 09 16:40:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbaa5ba-6c07-4a60-b880-c1c8c73e756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:40:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Flow 'volume_create_manager' (03748287-30d0-4442-bb0a-8ae420451584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:40:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-383fce8a-036d-46c0-aef1-06c3023ebc4a tempest-VolumesListTestJSON-89782055 None] Created volume successfully. Jul 09 16:41:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Acquiring lock "cinder-132c6436-b415-4e7d-860f-f9f5baf404e2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Lock "cinder-132c6436-b415-4e7d-860f-f9f5baf404e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Acquiring lock "cinder-quobyte-132c6436-b415-4e7d-860f-f9f5baf404e2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Lock "cinder-quobyte-132c6436-b415-4e7d-860f-f9f5baf404e2" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9764b-760b-4eba-84ca-ee68dc913537]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:02 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 Jul 09 16:41:02 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:03 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2" returned: 0 in 1.106s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:03 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2 Jul 09 16:41:03 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:04 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-132c6436-b415-4e7d-860f-f9f5baf404e2" returned: 0 in 1.109s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Lock "cinder-quobyte-132c6436-b415-4e7d-860f-f9f5baf404e2" released by "delete_volume" :: held 2.284s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Created reservations ['93b186f9-a744-48e8-a009-dde3490a5437', '2bd75f1b-6241-42a7-ae1b-9a2fc32cfab6', '3659a246-1efb-481c-99c8-c2f923755e52', 'a0db7b19-f80c-4f6c-b86e-145287e677fe'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:04 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:41:04 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:05 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.863s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:41:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Deleted volume successfully. Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f3a6eea9-0e6f-477d-8003-47f7fde37090 tempest-VolumesListTestJSON-89782055 None] Lock "cinder-132c6436-b415-4e7d-860f-f9f5baf404e2-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Acquiring lock "cinder-358fa862-7ca2-4883-bede-c96af29297c5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Lock "cinder-358fa862-7ca2-4883-bede-c96af29297c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Acquiring lock "cinder-quobyte-358fa862-7ca2-4883-bede-c96af29297c5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Lock "cinder-quobyte-358fa862-7ca2-4883-bede-c96af29297c5" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0dc2cd-74c7-4bf6-9f0e-e17acb38398a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:05 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 Jul 09 16:41:05 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:06 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5" returned: 0 in 1.005s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:06 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5 Jul 09 16:41:06 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:08 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-358fa862-7ca2-4883-bede-c96af29297c5" returned: 0 in 1.303s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Lock "cinder-quobyte-358fa862-7ca2-4883-bede-c96af29297c5" released by "delete_volume" :: held 2.379s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=97,cinder:UPDATE=102,cinder:INSERT=24,cinder:DELETE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Created reservations ['c4d556dc-0460-448d-a386-68a14de4a936', '861a880c-e9e9-4006-adc0-8895c27b0ba8', '7c46feea-f148-46bc-b98e-70d68a650915', '8ada6f3b-ca38-4269-858e-78b368a6906b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:08 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:41:08 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Acquiring lock "cinder-9c9a9031-de52-4f77-98ed-2cf0ef0995b2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Lock "cinder-9c9a9031-de52-4f77-98ed-2cf0ef0995b2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Acquiring lock "cinder-quobyte-9c9a9031-de52-4f77-98ed-2cf0ef0995b2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Lock "cinder-quobyte-9c9a9031-de52-4f77-98ed-2cf0ef0995b2" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1df082-b678-4572-b0a2-65fd4a27cda6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:09 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.570s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:41:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Deleted volume successfully. Jul 09 16:41:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ad094b99-f8a9-434e-8298-1240db990acb tempest-VolumesListTestJSON-89782055 None] Lock "cinder-358fa862-7ca2-4883-bede-c96af29297c5-delete_volume" released by "delete_volume" :: held 4.365s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:10 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 Jul 09 16:41:10 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:11 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2" returned: 0 in 1.695s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:11 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2 Jul 09 16:41:11 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:12 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9c9a9031-de52-4f77-98ed-2cf0ef0995b2" returned: 0 in 1.444s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Lock "cinder-quobyte-9c9a9031-de52-4f77-98ed-2cf0ef0995b2" released by "delete_volume" :: held 3.282s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Created reservations ['365628d0-8158-4dd0-a55e-1e582c5deddb', '3031431f-164e-47e1-a4ad-04569d0461b0', '9be19caa-1bc6-4eb2-8f6a-60de9d7d4a6a', 'ccb885b7-0f37-4384-bb56-13bb1f0a1b7d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:13 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:41:13 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Flow 'volume_create_manager' (15442ad8-f697-4952-b6b6-14533546a873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb949d9-876d-417a-9f0e-23142c08f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb949d9-876d-417a-9f0e-23142c08f118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1014734434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165c2b4a-c91a-4b0f-9f25-df2dd96f6597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacfbee1584e45968087e45e0bb634ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:14Z,use_quota=True,user_id='30448ac9046b48a7bc79a31d7bae6128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f79922-944e-4f1e-abe8-eb632324b2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f79922-944e-4f1e-abe8-eb632324b2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea8e51d-45c7-43a6-8ef3-4e9d0f55c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:13 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea8e51d-45c7-43a6-8ef3-4e9d0f55c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '165c2b4a-c91a-4b0f-9f25-df2dd96f6597', 'volume_name': 'volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12045934-7307-4ce8-b5ff-e467c8de25ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12045934-7307-4ce8-b5ff-e467c8de25ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abdac52-5fb8-4fed-b4cd-1521f5949ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Volume 165c2b4a-c91a-4b0f-9f25-df2dd96f6597: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 16:41:14 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Trying to clone 165c2b4a-c91a-4b0f-9f25-df2dd96f6597 from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.902s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:41:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Deleted volume successfully. Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e69a1e0f-c1ee-4c05-b603-2ed6d0a43f1f tempest-VolumesListTestJSON-89782055 None] Lock "cinder-9c9a9031-de52-4f77-98ed-2cf0ef0995b2-delete_volume" released by "delete_volume" :: held 4.655s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:41:14 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Image download 20.69 MB at 20.69 MB/s Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bd5352-8403-4ab3-b47b-caa1813e399a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:15 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD Jul 09 16:41:15 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:15 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD" returned: 0 in 1.114s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:15 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 is fetched for user 30448ac9046b48a7bc79a31d7bae6128. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:41:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7964ef1-ea40-40c7-8934-24f161262d00]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:16 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD Jul 09 16:41:16 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:17 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD" returned: 0 in 1.221s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1014734434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165c2b4a-c91a-4b0f-9f25-df2dd96f6597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacfbee1584e45968087e45e0bb634ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:14Z,use_quota=True,user_id='30448ac9046b48a7bc79a31d7bae6128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Creating volume 165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:41:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:41:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:17 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 1073741824 Jul 09 16:41:17 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:18 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 1073741824" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:18 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 Jul 09 16:41:18 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:19 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" returned: 0 in 1.089s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:41:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:19 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Attempting download of de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 165c2b4a-c91a-4b0f-9f25-df2dd96f6597. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:41:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce91f6-6077-4595-bfd2-68b7fb9d3bed]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ac7h5w58 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:19 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ac7h5w58 Jul 09 16:41:19 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:20 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ac7h5w58" returned: 0 in 1.207s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ac7h5w58 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:21 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ac7h5w58 Jul 09 16:41:21 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:22 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ac7h5w58" returned: 1 in 1.102s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ac7h5w58' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4728cd4-4c53-430b-bb22-8cd8fb6cb939]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:22 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD Jul 09 16:41:22 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:23 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD" returned: 0 in 1.002s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:23 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] de3c03b3-c1ea-429a-9d20-5eaeb1379637 was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:41:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:23 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 Jul 09 16:41:23 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Flow 'volume_create_manager' (3bcc02f4-a5f9-445d-a933-b04c6ce6861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944edc82-8ae0-4353-bdd3-80a9ea23c04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944edc82-8ae0-4353-bdd3-80a9ea23c04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513b5187-9ba9-47fe-9018-4ea79828f775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90992d944880495ba45a0946bf4048a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:24Z,use_quota=True,user_id='6e466e9830e34dc6ab7d3654f403f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbac61d-6331-48f4-b184-7c647924fb0d),volume_type_id=5fbac61d-6331-48f4-b184-7c647924fb0d)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f01dea9-a504-49c0-aeff-a90218c8dd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f01dea9-a504-49c0-aeff-a90218c8dd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df899d3-4c21-49e7-9d91-a7e5b5532067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df899d3-4c21-49e7-9d91-a7e5b5532067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '513b5187-9ba9-47fe-9018-4ea79828f775', 'volume_name': 'volume-513b5187-9ba9-47fe-9018-4ea79828f775', 'volume_size': 1, 'image_id': '4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a18abbda72b8a00f72ae4f0a79bba86a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90992d944880495ba45a0946bf4048a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd77e2a848fffd72f82927d1c50291f77f1163d66ba9a093ec8672fd68c0ecd09c1c1af5d62316f3959db12e873565da3218c8b978600105b54744b2f931f9c39', 'id': '4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'created_at': datetime.datetime(2026, 7, 9, 14, 41, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 41, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e00655-df44-45ad-9cc6-48cd6f112d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e00655-df44-45ad-9cc6-48cd6f112d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd592c01-61cc-425a-bc2b-2d333bbc9b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Volume 513b5187-9ba9-47fe-9018-4ea79828f775: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-513b5187-9ba9-47fe-9018-4ea79828f775', 'volume_size': 1, 'image_id': '4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a18abbda72b8a00f72ae4f0a79bba86a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90992d944880495ba45a0946bf4048a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd77e2a848fffd72f82927d1c50291f77f1163d66ba9a093ec8672fd68c0ecd09c1c1af5d62316f3959db12e873565da3218c8b978600105b54744b2f931f9c39', 'id': '4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'created_at': datetime.datetime(2026, 7, 9, 14, 41, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 41, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Trying to clone 513b5187-9ba9-47fe-9018-4ea79828f775 from image 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:41:24 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Image download 0.00 MB at 0.00 MB/s Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9cfdd6-5239-4c5d-b2a6-c3b957410b85]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:25 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD Jul 09 16:41:25 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:25 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" returned: 0 in 2.394s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:25 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_b32kxnigdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:41:25 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Converted 112.00 MB image at 46.77 MB/s Jul 09 16:41:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:25 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 1G Jul 09 16:41:25 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:25 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:25 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD Jul 09 16:41:25 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:26 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 1G" returned: 0 in 0.750s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e73913-16a3-4bea-a305-5437f022a72c]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:26 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 Jul 09 16:41:26 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:26 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Temporary image 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea is fetched for user 6e466e9830e34dc6ab7d3654f403f88b. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c467265c-55ac-4a9b-86b0-9cbc967b2278]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:26 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD Jul 09 16:41:26 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:27 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:27 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 Jul 09 16:41:27 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:27 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:27 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD Jul 09 16:41:27 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:27 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" returned: 1 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Downloaded image de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 165c2b4a-c91a-4b0f-9f25-df2dd96f6597 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 for user 30448ac9046b48a7bc79a31d7bae6128 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Marking volume 165c2b4a-c91a-4b0f-9f25-df2dd96f6597 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Copying metadata from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 to 165c2b4a-c91a-4b0f-9f25-df2dd96f6597. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:41:27 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Creating volume glance metadata for volume 165c2b4a-c91a-4b0f-9f25-df2dd96f6597 backed by image de3c03b3-c1ea-429a-9d20-5eaeb1379637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abdac52-5fb8-4fed-b4cd-1521f5949ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac70c019-bddd-4e4b-bd54-edf33cd19de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Volume volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 (165c2b4a-c91a-4b0f-9f25-df2dd96f6597): created successfully Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac70c019-bddd-4e4b-bd54-edf33cd19de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Flow 'volume_create_manager' (15442ad8-f697-4952-b6b6-14533546a873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f32dd4a8-256f-474d-b257-c457015a7d5a tempest-VolumesImageMetadata-1829553015 None] Created volume successfully. Jul 09 16:41:28 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD" returned: 1 in 0.847s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513b5187-9ba9-47fe-9018-4ea79828f775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90992d944880495ba45a0946bf4048a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:24Z,use_quota=True,user_id='6e466e9830e34dc6ab7d3654f403f88b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fbac61d-6331-48f4-b184-7c647924fb0d),volume_type_id=5fbac61d-6331-48f4-b184-7c647924fb0d)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Creating volume 513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:41:28 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:28 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 1073741824 Jul 09 16:41:28 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:28 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:41:28 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:29 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 1073741824" returned: 0 in 0.997s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:29 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 Jul 09 16:41:29 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Acquiring lock "cinder-165c2b4a-c91a-4b0f-9f25-df2dd96f6597-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Lock "cinder-165c2b4a-c91a-4b0f-9f25-df2dd96f6597-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Acquiring lock "cinder-quobyte-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Lock "cinder-quobyte-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:29 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d138ad48-8a5e-4472-9f7e-9cfd05ebd695]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:29 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 Jul 09 16:41:29 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:30 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775" returned: 0 in 0.897s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Attempting download of 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea ((None, [{'url': 'file:///opt/stack/data/glance/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'metadata': {}}])) to volume 513b5187-9ba9-47fe-9018-4ea79828f775. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347c094-35d0-4558-9aaa-9b9a296f5e9e]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_jbm00f7s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:30 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_jbm00f7s Jul 09 16:41:30 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:30 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" returned: 0 in 1.023s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:30 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 Jul 09 16:41:30 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:31 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_jbm00f7s" returned: 0 in 0.806s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_jbm00f7s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:31 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_jbm00f7s Jul 09 16:41:31 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:31 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" returned: 1 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:31 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597 Jul 09 16:41:31 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:31 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_jbm00f7s" returned: 1 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_jbm00f7s' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfae94a-12aa-4131-945e-37e5d7b7e3ad]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:31 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD Jul 09 16:41:31 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:32 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" returned: 0 in 0.688s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Lock "cinder-quobyte-165c2b4a-c91a-4b0f-9f25-df2dd96f6597" released by "delete_volume" :: held 2.724s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Created reservations ['a3fcd180-1b73-437e-9c34-73ed751e413b', '58813c8a-885b-4abe-9ca7-43bd848a715b', 'feb85fff-d83f-4bc2-aa0c-874dcb78d393', '2f5421de-8bf4-4d29-9d8f-035eed7bcb7c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:32 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:41:32 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:32 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:32 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD Jul 09 16:41:32 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:33 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.869s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:33 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:41:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Deleted volume successfully. Jul 09 16:41:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-789abed0-920c-486a-a3b1-ee7bfd67d8ac tempest-VolumesImageMetadata-1829553015 None] Lock "cinder-165c2b4a-c91a-4b0f-9f25-df2dd96f6597-delete_volume" released by "delete_volume" :: held 3.915s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:33 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD" returned: 1 in 1.187s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:33 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:41:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:33 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 Jul 09 16:41:33 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:34 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775" returned: 0 in 0.978s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:34 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea_wm1cfxwrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:41:34 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 16:41:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:34 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 1G Jul 09 16:41:34 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-3e5553d5-e8a2-43ad-b8aa-e9f3c7d1cecc req-3fb8c5da-1661-4574-a87c-cde958dcc287 tempest-AttachVolumeTestJSON-1630178730 None] Terminate volume connection completed successfully. Jul 09 16:41:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-3e5553d5-e8a2-43ad-b8aa-e9f3c7d1cecc req-3fb8c5da-1661-4574-a87c-cde958dcc287 tempest-AttachVolumeTestJSON-1630178730 None] Deleting attachment cf38f882-05d9-40f8-9a64-65739c895b72. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:41:35 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 1G" returned: 0 in 0.931s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d4e54-9942-4d50-80f9-f3386e36dc90]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:36 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 Jul 09 16:41:36 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:36 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775" returned: 0 in 0.987s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:36 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 Jul 09 16:41:36 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:37 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775" returned: 1 in 0.843s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Downloaded image 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea ((None, [{'url': 'file:///opt/stack/data/glance/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'metadata': {}}])) to volume 513b5187-9ba9-47fe-9018-4ea79828f775 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Temporary image 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea for user 6e466e9830e34dc6ab7d3654f403f88b is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Marking volume 513b5187-9ba9-47fe-9018-4ea79828f775 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Copying metadata from image 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea to 513b5187-9ba9-47fe-9018-4ea79828f775. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Creating volume glance metadata for volume 513b5187-9ba9-47fe-9018-4ea79828f775 backed by image 4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a18abbda72b8a00f72ae4f0a79bba86a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd592c01-61cc-425a-bc2b-2d333bbc9b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513b5187-9ba9-47fe-9018-4ea79828f775', 'volume_size': 1, 'image_id': '4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a18abbda72b8a00f72ae4f0a79bba86a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '90992d944880495ba45a0946bf4048a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd77e2a848fffd72f82927d1c50291f77f1163d66ba9a093ec8672fd68c0ecd09c1c1af5d62316f3959db12e873565da3218c8b978600105b54744b2f931f9c39', 'id': '4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea', 'created_at': datetime.datetime(2026, 7, 9, 14, 41, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 41, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e41fb3b-eb2b-49c8-b793-b00ea78dd3ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037fad3e-a28f-46dc-a503-7a6a10aee660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:37 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Volume volume-513b5187-9ba9-47fe-9018-4ea79828f775 (513b5187-9ba9-47fe-9018-4ea79828f775): created successfully Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037fad3e-a28f-46dc-a503-7a6a10aee660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Flow 'volume_create_manager' (3bcc02f4-a5f9-445d-a933-b04c6ce6861a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d5b69fc9-8aa3-4da2-be5f-2f9a1526972e tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Created volume successfully. Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Flow 'volume_create_manager' (10acc462-f068-4665-9e12-6ecb2cc9cd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22af1b27-964c-43f7-8677-df459e1936e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22af1b27-964c-43f7-8677-df459e1936e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-246492339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fc728c-0550-4160-8d89-8fdadb1584c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ac77b28e56498aa1d78fd0d65ef529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:38Z,use_quota=True,user_id='dcf357e551ee4d1c8933da057ed8c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20e7f6-a65b-488e-ac09-346d8ef7ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20e7f6-a65b-488e-ac09-346d8ef7ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830862ce-100c-4193-8ffe-61ca843e8b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830862ce-100c-4193-8ffe-61ca843e8b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1fc728c-0550-4160-8d89-8fdadb1584c0', 'volume_name': 'volume-a1fc728c-0550-4160-8d89-8fdadb1584c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43cc9a-be83-42f6-b69c-f9288cf864da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43cc9a-be83-42f6-b69c-f9288cf864da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41996125-7304-49ab-843d-0cc9f8e2ac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:37 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Volume a1fc728c-0550-4160-8d89-8fdadb1584c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1fc728c-0550-4160-8d89-8fdadb1584c0', 'volume_size': 1} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-246492339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fc728c-0550-4160-8d89-8fdadb1584c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ac77b28e56498aa1d78fd0d65ef529',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:38Z,use_quota=True,user_id='dcf357e551ee4d1c8933da057ed8c478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Creating volume a1fc728c-0550-4160-8d89-8fdadb1584c0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:41:37 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:41:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:38 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 1073741824 Jul 09 16:41:38 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Acquiring lock "cinder-513b5187-9ba9-47fe-9018-4ea79828f775-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "cinder-513b5187-9ba9-47fe-9018-4ea79828f775-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Acquiring lock "cinder-quobyte-513b5187-9ba9-47fe-9018-4ea79828f775" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "cinder-quobyte-513b5187-9ba9-47fe-9018-4ea79828f775" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e2d66a-a55b-498c-b708-bbe0bc0be117]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:38 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 Jul 09 16:41:38 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:38 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 1073741824" returned: 0 in 0.905s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:38 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 Jul 09 16:41:38 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:39 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:39 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 Jul 09 16:41:39 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:39 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0" returned: 0 in 0.991s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:41:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41996125-7304-49ab-843d-0cc9f8e2ac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1fc728c-0550-4160-8d89-8fdadb1584c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b662660e-7fa9-4788-8d24-1dfd4253c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Volume volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 (a1fc728c-0550-4160-8d89-8fdadb1584c0): created successfully Jul 09 16:41:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b662660e-7fa9-4788-8d24-1dfd4253c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Flow 'volume_create_manager' (10acc462-f068-4665-9e12-6ecb2cc9cd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b618af9f-b5a1-4a6a-b194-8e30afccfab4 tempest-AbsoluteLimitsTests-449194845 None] Created volume successfully. Jul 09 16:41:40 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775" returned: 1 in 1.152s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:41:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:40 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775 Jul 09 16:41:40 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Acquiring lock "cinder-a1fc728c-0550-4160-8d89-8fdadb1584c0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Lock "cinder-a1fc728c-0550-4160-8d89-8fdadb1584c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Acquiring lock "cinder-quobyte-a1fc728c-0550-4160-8d89-8fdadb1584c0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Lock "cinder-quobyte-a1fc728c-0550-4160-8d89-8fdadb1584c0" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed7fb61-c361-4ff2-8a2d-b20d71fcb435]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:41 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-513b5187-9ba9-47fe-9018-4ea79828f775" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "cinder-quobyte-513b5187-9ba9-47fe-9018-4ea79828f775" released by "delete_volume" :: held 2.860s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:41 devstack cinder-volume[87204]: WARNING cinder.quota [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:41:41 devstack cinder-volume[87204]: WARNING cinder.quota [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:41:41 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 Jul 09 16:41:41 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Created reservations ['6ffafdf4-c603-4e0d-8fbd-4346ee8e905d', 'c9671de4-d136-489b-9643-1d8ea4b353ce', 'a5347481-ac49-43bb-8655-3ce15bdca687', '2cd8ef81-caea-4f3b-85aa-aaf60d0f9ae0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:41 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:41:41 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:42 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.985s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:42 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:41:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Deleted volume successfully. Jul 09 16:41:42 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0" returned: 0 in 1.359s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:42 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0 Jul 09 16:41:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-84413e46-a3c1-4ba4-8bfa-3c112f479956 tempest-VolumeAndVolumeTypeFromImageTest-39624525 None] Lock "cinder-513b5187-9ba9-47fe-9018-4ea79828f775-delete_volume" released by "delete_volume" :: held 4.243s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:42 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:43 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a1fc728c-0550-4160-8d89-8fdadb1584c0" returned: 0 in 0.812s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Lock "cinder-quobyte-a1fc728c-0550-4160-8d89-8fdadb1584c0" released by "delete_volume" :: held 2.233s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Created reservations ['6fd04c2f-b7b1-483c-a210-c252e2e35caa', '3ab0314c-ced9-4d70-b08c-c66a0f23a350', '53569230-e351-4bcd-8f7f-1db6cfaf0c22', '5a3549c3-e144-4670-8bb4-cebe758dc52e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:43 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:41:43 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:45 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.404s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:45 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:41:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Deleted volume successfully. Jul 09 16:41:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5d807167-ba11-4198-8700-d44d28ef7a5b tempest-AbsoluteLimitsTests-449194845 None] Lock "cinder-a1fc728c-0550-4160-8d89-8fdadb1584c0-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=67,cinder:UPDATE=87,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (6adfc361-9768-4e9a-8ea4-8e8414affd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69862de-86bb-4c8d-a662-23e4a19c5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69862de-86bb-4c8d-a662-23e4a19c5245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115466056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e078af4c-73fc-476d-a61d-7d7619804601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:51Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dc972d-a5b4-49ed-93a7-2cb7c5ac5e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dc972d-a5b4-49ed-93a7-2cb7c5ac5e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a0274d-4a8c-4c91-afd9-80569a0793fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a0274d-4a8c-4c91-afd9-80569a0793fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e078af4c-73fc-476d-a61d-7d7619804601', 'volume_name': 'volume-e078af4c-73fc-476d-a61d-7d7619804601', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f608a68-65ac-4b12-9faa-3fe7247d8edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f608a68-65ac-4b12-9faa-3fe7247d8edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74227c3-3aed-4152-865d-188560388fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume e078af4c-73fc-476d-a61d-7d7619804601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e078af4c-73fc-476d-a61d-7d7619804601', 'volume_size': 1} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2115466056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e078af4c-73fc-476d-a61d-7d7619804601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:51Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Creating volume e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:41:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:41:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:51 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 1073741824 Jul 09 16:41:51 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:52 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 1073741824" returned: 0 in 1.409s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:52 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 Jul 09 16:41:52 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Flow 'volume_create_manager' (543d117a-1e6e-4cf2-9b3b-20d086cd3284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f3620e-9d9a-4465-89e8-5ba35c7500b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f3620e-9d9a-4465-89e8-5ba35c7500b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-709690998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1feb722c-5994-40e4-9bc2-ee1c62d77927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290862678d2a4dd2a949f0f927d1d6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:53Z,use_quota=True,user_id='1dec436155c449289ec1750783cf3d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85001221-4a88-41eb-972a-7eacda0135df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85001221-4a88-41eb-972a-7eacda0135df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:53 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4a96af-7467-4421-9afa-3909fb889eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4a96af-7467-4421-9afa-3909fb889eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1feb722c-5994-40e4-9bc2-ee1c62d77927', 'volume_name': 'volume-1feb722c-5994-40e4-9bc2-ee1c62d77927', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390654a0-c76d-4e54-86ac-4645bf182d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390654a0-c76d-4e54-86ac-4645bf182d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361e4c4c-9f11-468d-8101-439d4c0b28a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Volume 1feb722c-5994-40e4-9bc2-ee1c62d77927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1feb722c-5994-40e4-9bc2-ee1c62d77927', 'volume_size': 1} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601" returned: 0 in 0.932s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-709690998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1feb722c-5994-40e4-9bc2-ee1c62d77927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290862678d2a4dd2a949f0f927d1d6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:41:53Z,use_quota=True,user_id='1dec436155c449289ec1750783cf3d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Creating volume 1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:41:53 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74227c3-3aed-4152-865d-188560388fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e078af4c-73fc-476d-a61d-7d7619804601', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:53 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 1073741824 Jul 09 16:41:53 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519ed01a-c64f-4952-89d9-78d5857e7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume volume-e078af4c-73fc-476d-a61d-7d7619804601 (e078af4c-73fc-476d-a61d-7d7619804601): created successfully Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519ed01a-c64f-4952-89d9-78d5857e7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (6adfc361-9768-4e9a-8ea4-8e8414affd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2267b2be-47ec-45de-98b5-61d0cfc4c275 tempest-CreateVolumesFromSnapshotTest-53996244 None] Created volume successfully. Jul 09 16:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:54 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 1073741824" returned: 0 in 1.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:54 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 Jul 09 16:41:54 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:55 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927" returned: 0 in 0.671s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.818s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Creating offline snapshot 909f3b70-f749-43d7-bc97-01a1c14faca1 of volume e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361e4c4c-9f11-468d-8101-439d4c0b28a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1feb722c-5994-40e4-9bc2-ee1c62d77927', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d1fed2-c74f-4acf-9a4e-be677818618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[feab0289-898b-4eb2-92d3-4afbb6f9cda7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:55 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Volume volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 (1feb722c-5994-40e4-9bc2-ee1c62d77927): created successfully Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d1fed2-c74f-4acf-9a4e-be677818618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Flow 'volume_create_manager' (543d117a-1e6e-4cf2-9b3b-20d086cd3284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:41:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fe7dc93e-ad68-4177-8046-8bd69a3a6658 tempest-VolumesDeleteCascade-1770368608 None] Created volume successfully. Jul 09 16:41:55 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 Jul 09 16:41:55 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:41:56 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601" returned: 0 in 0.933s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:56 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 1G Jul 09 16:41:56 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:56 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 1G" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e078af4c-73fc-476d-a61d-7d7619804601 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:56 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e078af4c-73fc-476d-a61d-7d7619804601 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 Jul 09 16:41:56 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:57 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e078af4c-73fc-476d-a61d-7d7619804601 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1" returned: 0 in 0.691s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:57 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 is being set with open permissions: ugo+rw Jul 09 16:41:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:57 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 Jul 09 16:41:57 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:58 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1" returned: 0 in 0.640s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:58 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.info Jul 09 16:41:58 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:58 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.info" returned: 0 in 0.649s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:58 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.info is being set with open permissions: ugo+rw Jul 09 16:41:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:58 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.info Jul 09 16:41:58 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:41:59 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 09 16:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.info" returned: 0 in 0.638s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.491s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.907s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:41:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Creating offline snapshot d51cea8a-f258-4795-b59c-3231d688d07d of volume 1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:41:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-36611015-a88b-487a-885f-29a787944ce1 tempest-CreateVolumesFromSnapshotTest-53996244 None] Create snapshot completed successfully Jul 09 16:41:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa428388-aaa8-47f4-8ea2-5054d0e1d0de]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:41:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:41:59 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 Jul 09 16:41:59 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:00 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:00 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d 1G Jul 09 16:42:00 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (6f64bf6b-774a-41f6-ae1e-ab6cd73c56ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658e5885-4f1d-4e8f-9b06-ff93af42e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658e5885-4f1d-4e8f-9b06-ff93af42e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1201626607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:01Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44f65b4-a8fe-40c5-8f9f-ed48925537d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44f65b4-a8fe-40c5-8f9f-ed48925537d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795fc487-947c-47bc-8216-95ea724350c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795fc487-947c-47bc-8216-95ea724350c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe', 'volume_name': 'volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9988f5-578b-42cc-8291-e27995c2f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9988f5-578b-42cc-8291-e27995c2f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb95ac28-f80d-49c8-b5dc-2370d5beea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe', 'volume_size': 1} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:01 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d 1G" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:01 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d Jul 09 16:42:01 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (99d16011-68f0-4084-bac7-28df9942360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e1d848-e5f5-47bd-8609-2321059517b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e1d848-e5f5-47bd-8609-2321059517b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1309876037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcabbfd-273f-4ae3-8c08-309d4ccb8de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:01Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e31a52-9cf9-4c10-a9d8-f226042199eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e31a52-9cf9-4c10-a9d8-f226042199eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e560fb6-a2d4-45c0-a1df-dcda2a1f2ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e560fb6-a2d4-45c0-a1df-dcda2a1f2ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abcabbfd-273f-4ae3-8c08-309d4ccb8de9', 'volume_name': 'volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad25506a-b1b8-49eb-864e-70c8eb178dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad25506a-b1b8-49eb-864e-70c8eb178dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d558c2b7-a52d-4fdd-85e3-a3c673399957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume abcabbfd-273f-4ae3-8c08-309d4ccb8de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9', 'volume_size': 1} Jul 09 16:42:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (507bba7f-d8cf-491a-be48-cb85c0312a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91dcd45-c919-4036-9436-1d526bb7a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91dcd45-c919-4036-9436-1d526bb7a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834562478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4f582c-5e8f-48b8-987c-39d27549089c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:02Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f16060-b415-4b04-84b3-6c9392133982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f16060-b415-4b04-84b3-6c9392133982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca6e5fb-263f-4f04-be44-061401bb496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca6e5fb-263f-4f04-be44-061401bb496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4f582c-5e8f-48b8-987c-39d27549089c', 'volume_name': 'volume-cb4f582c-5e8f-48b8-987c-39d27549089c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a659598-46e3-47a4-b0cd-ea5908de45b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a659598-46e3-47a4-b0cd-ea5908de45b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e4c06-2fb9-43d2-a704-8a577733ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume cb4f582c-5e8f-48b8-987c-39d27549089c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4f582c-5e8f-48b8-987c-39d27549089c', 'volume_size': 1} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:02 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d" returned: 0 in 1.042s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:02 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d is being set with open permissions: ugo+rw Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:02 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d Jul 09 16:42:02 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (6693e401-b4b3-46cc-ba67-adbf097d4c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3783fe-db9b-4b46-9511-cf303ee60cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3783fe-db9b-4b46-9511-cf303ee60cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1653488365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58c9abe-7618-4169-9673-678f1055c1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:03Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159439ab-2d8e-4a18-b992-8af849f95dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159439ab-2d8e-4a18-b992-8af849f95dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69050d4c-b828-4f35-911e-f87e7d46eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69050d4c-b828-4f35-911e-f87e7d46eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58c9abe-7618-4169-9673-678f1055c1d5', 'volume_name': 'volume-a58c9abe-7618-4169-9673-678f1055c1d5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43e232e-8195-4a89-a534-150a8f805d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43e232e-8195-4a89-a534-150a8f805d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cdaf70-f700-4273-9443-c79686cee988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume a58c9abe-7618-4169-9673-678f1055c1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58c9abe-7618-4169-9673-678f1055c1d5', 'volume_size': 1} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (db5d74d9-e730-4419-8ad5-e9c70f67ac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62eda99-531a-40b1-a6c2-d4efbe1a4bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62eda99-531a-40b1-a6c2-d4efbe1a4bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-596950640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08eb02ad-bc7c-4b1f-8926-0d14077a250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:03Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35fb9f3-4fb0-489c-8848-5dc30da53583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35fb9f3-4fb0-489c-8848-5dc30da53583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6e3774-9c57-472e-b1dc-3bd2c1f2a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6e3774-9c57-472e-b1dc-3bd2c1f2a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08eb02ad-bc7c-4b1f-8926-0d14077a250d', 'volume_name': 'volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38846922-55b6-4378-b69a-e935929b2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38846922-55b6-4378-b69a-e935929b2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3806f89-eab9-4a51-92d7-a22337f7a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume 08eb02ad-bc7c-4b1f-8926-0d14077a250d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d', 'volume_size': 1} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:03 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d" returned: 0 in 1.085s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:03 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.info Jul 09 16:42:03 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:04 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.info" returned: 0 in 0.664s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:04 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.info is being set with open permissions: ugo+rw Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:04 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.info Jul 09 16:42:04 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:04 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.info" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.202s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.567s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1201626607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:01Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Creating volume dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:04 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:04 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe 1073741824 Jul 09 16:42:04 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1143e264-646b-402e-9f20-6fa85274bbde tempest-VolumesDeleteCascade-1770368608 None] Create snapshot completed successfully Jul 09 16:42:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:05 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe 1073741824" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:05 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe Jul 09 16:42:05 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:06 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe" returned: 0 in 0.685s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.702s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1309876037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcabbfd-273f-4ae3-8c08-309d4ccb8de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:01Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Creating volume abcabbfd-273f-4ae3-8c08-309d4ccb8de9 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:06 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb95ac28-f80d-49c8-b5dc-2370d5beea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6704d317-1a6a-4540-a64f-c00ba6fd3201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:06 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 1073741824 Jul 09 16:42:06 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe (dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe): created successfully Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6704d317-1a6a-4540-a64f-c00ba6fd3201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (6f64bf6b-774a-41f6-ae1e-ab6cd73c56ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-36cd3faf-a6ac-4168-af1a-65effc1b4a3b tempest-CreateVolumesFromSnapshotTest-53996244 None] Created volume successfully. Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:07 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Flow 'volume_create_manager' (304e0918-3a06-4add-8dc3-759d3f7f0757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6409d6a-7e80-4eb9-a12c-f77c59f58e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 1073741824" returned: 0 in 0.963s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6409d6a-7e80-4eb9-a12c-f77c59f58e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-914243427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda20f45-9620-4b8e-a4e9-4194bfd45695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='533ed13ee645447a95e27f3a0ff7459f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:07Z,use_quota=True,user_id='55e1eb1c352c4cb6b92c73f81719a1a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04599b36-7bfc-4704-8452-ea04783dbeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04599b36-7bfc-4704-8452-ea04783dbeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b50ad9e-09ad-4cb2-af22-60ea7b2c4d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b50ad9e-09ad-4cb2-af22-60ea7b2c4d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda20f45-9620-4b8e-a4e9-4194bfd45695', 'volume_name': 'volume-dda20f45-9620-4b8e-a4e9-4194bfd45695', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd91d4c4-2e19-45f4-a51b-10ec139fffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd91d4c4-2e19-45f4-a51b-10ec139fffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173da206-5d70-4c8f-bbd4-c3a3ed3b5d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Volume dda20f45-9620-4b8e-a4e9-4194bfd45695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda20f45-9620-4b8e-a4e9-4194bfd45695', 'volume_size': 1} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:07 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 Jul 09 16:42:07 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:08 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9" returned: 0 in 0.680s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.936s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834562478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4f582c-5e8f-48b8-987c-39d27549089c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:02Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Creating volume cb4f582c-5e8f-48b8-987c-39d27549089c {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:08 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c 1073741824 Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d558c2b7-a52d-4fdd-85e3-a3c673399957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:08 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7135cf-c6e9-4506-84dc-f4cf38c0d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 (abcabbfd-273f-4ae3-8c08-309d4ccb8de9): created successfully Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7135cf-c6e9-4506-84dc-f4cf38c0d288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (99d16011-68f0-4084-bac7-28df9942360d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d2572ade-6a9c-4e4f-ac2a-a0f6d3fb581c tempest-CreateVolumesFromSnapshotTest-53996244 None] Created volume successfully. Jul 09 16:42:08 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c 1073741824" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:INSERT=26,cinder:UPDATE=69,cinder:SELECT=74,cinder:DELETE=8 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:42:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:09 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c Jul 09 16:42:09 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:09 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c" returned: 0 in 0.651s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.796s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1653488365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58c9abe-7618-4169-9673-678f1055c1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:03Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Creating volume a58c9abe-7618-4169-9673-678f1055c1d5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:09 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9e4c06-2fb9-43d2-a704-8a577733ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4f582c-5e8f-48b8-987c-39d27549089c', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:09 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 1073741824 Jul 09 16:42:09 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7bcee7-0d15-41a7-8c2c-0ee35f58ade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume volume-cb4f582c-5e8f-48b8-987c-39d27549089c (cb4f582c-5e8f-48b8-987c-39d27549089c): created successfully Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7bcee7-0d15-41a7-8c2c-0ee35f58ade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (507bba7f-d8cf-491a-be48-cb85c0312a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9a0307be-7698-42f7-90fc-e3539f6a8d28 tempest-CreateVolumesFromSnapshotTest-53996244 None] Created volume successfully. Jul 09 16:42:10 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 1073741824" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:10 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 Jul 09 16:42:10 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:11 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5" returned: 0 in 0.670s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.092s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-596950640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08eb02ad-bc7c-4b1f-8926-0d14077a250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d852aab6a6f475fabf0af0adb1c5aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:03Z,use_quota=True,user_id='5ea497aaa8ee4ab39edec5e249d22647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Creating volume 08eb02ad-bc7c-4b1f-8926-0d14077a250d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:11 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cdaf70-f700-4273-9443-c79686cee988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58c9abe-7618-4169-9673-678f1055c1d5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce544a0-9c0a-40e8-af83-4933e772552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:11 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d 1073741824 Jul 09 16:42:11 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:11 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume volume-a58c9abe-7618-4169-9673-678f1055c1d5 (a58c9abe-7618-4169-9673-678f1055c1d5): created successfully Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce544a0-9c0a-40e8-af83-4933e772552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (6693e401-b4b3-46cc-ba67-adbf097d4c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-233b6776-0d4e-4446-bb45-fce706d4b5c3 tempest-CreateVolumesFromSnapshotTest-53996244 None] Created volume successfully. Jul 09 16:42:12 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d 1073741824" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:12 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d Jul 09 16:42:12 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:12 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d" returned: 0 in 0.683s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.407s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3806f89-eab9-4a51-92d7-a22337f7a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a01634-c555-47a2-afd4-002ac0446d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Creating offline snapshot a3c7e280-4046-45f9-87bc-dc538178c075 of volume 1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:42:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Volume volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d (08eb02ad-bc7c-4b1f-8926-0d14077a250d): created successfully Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a01634-c555-47a2-afd4-002ac0446d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Flow 'volume_create_manager' (db5d74d9-e730-4419-8ad5-e9c70f67ac05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a71ea9b-c888-4c9c-a7bd-e5b0235abfe6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-55112334-fbf0-436d-bb2b-587d7f80d08d tempest-CreateVolumesFromSnapshotTest-53996244 None] Created volume successfully. Jul 09 16:42:12 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d Jul 09 16:42:12 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:13 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d" returned: 0 in 0.778s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1feb722c-5994-40e4-9bc2-ee1c62d77927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:13 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 1G Jul 09 16:42:13 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-08eb02ad-bc7c-4b1f-8926-0d14077a250d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-08eb02ad-bc7c-4b1f-8926-0d14077a250d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-08eb02ad-bc7c-4b1f-8926-0d14077a250d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-08eb02ad-bc7c-4b1f-8926-0d14077a250d" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[06778c81-0cf1-40be-ab27-a4aaf260d90c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:13 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d Jul 09 16:42:13 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:14 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 1G" returned: 0 in 1.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:14 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 Jul 09 16:42:14 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:14 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d" returned: 0 in 0.972s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:14 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d Jul 09 16:42:14 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:15 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:15 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 is being set with open permissions: ugo+rw Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:15 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 Jul 09 16:42:15 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:15 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-08eb02ad-bc7c-4b1f-8926-0d14077a250d" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-08eb02ad-bc7c-4b1f-8926-0d14077a250d" released by "delete_volume" :: held 1.829s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Created reservations ['9eb52546-11d8-4ecf-83c0-977d4211aba4', '75ca49db-38ae-4d67-bcbe-97862b017758', 'c58964c3-612f-402d-bb41-d8d15129d15d', '458339e6-4e61-42bb-986c-b0e39adee231'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:15 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:15 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-a58c9abe-7618-4169-9673-678f1055c1d5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-a58c9abe-7618-4169-9673-678f1055c1d5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-a58c9abe-7618-4169-9673-678f1055c1d5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-a58c9abe-7618-4169-9673-678f1055c1d5" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5815990-5336-47d0-81f6-f219fdaa2450]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:16 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 Jul 09 16:42:16 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:16 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075" returned: 0 in 0.892s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.655s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-914243427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda20f45-9620-4b8e-a4e9-4194bfd45695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='533ed13ee645447a95e27f3a0ff7459f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:07Z,use_quota=True,user_id='55e1eb1c352c4cb6b92c73f81719a1a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Creating volume dda20f45-9620-4b8e-a4e9-4194bfd45695 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:16 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:16 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 1073741824 Jul 09 16:42:16 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1d9d817f-151b-44b8-b118-af603cc325e9 tempest-VolumesDeleteCascade-1770368608 None] Create snapshot completed successfully Jul 09 16:42:16 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Deleted volume successfully. Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7bad65da-8223-46dc-b414-765ff9698d2b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-08eb02ad-bc7c-4b1f-8926-0d14077a250d-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-1feb722c-5994-40e4-9bc2-ee1c62d77927-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-1feb722c-5994-40e4-9bc2-ee1c62d77927-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Performing cascade delete. {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-a3c7e280-4046-45f9-87bc-dc538178c075-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-a3c7e280-4046-45f9-87bc-dc538178c075-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-a3c7e280-4046-45f9-87bc-dc538178c075" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-a3c7e280-4046-45f9-87bc-dc538178c075" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Deleting offline snapshot a3c7e280-4046-45f9-87bc-dc538178c075 of volume 1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] snapshot_file for this snap is: volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f48e0e-9380-4b38-ab83-91d46e78c59b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:17 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5" returned: 0 in 1.047s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:17 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5 Jul 09 16:42:17 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:17 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 Jul 09 16:42:17 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:17 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 1073741824" returned: 0 in 1.129s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:17 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 Jul 09 16:42:17 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:18 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a58c9abe-7618-4169-9673-678f1055c1d5" returned: 0 in 0.853s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-a58c9abe-7618-4169-9673-678f1055c1d5" released by "delete_volume" :: held 1.959s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:18 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075" returned: 0 in 0.984s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1feb722c-5994-40e4-9bc2-ee1c62d77927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcd762e-0a2d-4edf-93fc-dd224c15b793]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Created reservations ['7bae644b-80b8-4574-8c3c-038f72944376', 'f1db37de-ebcb-412b-abca-d5ffae6488cd', '6be54599-6ee0-4f16-8627-a1fb5b3e84c4', 'e4ed7551-c752-4bb3-b9f9-18eb75049465'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:18 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d Jul 09 16:42:18 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:18 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:18 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-cb4f582c-5e8f-48b8-987c-39d27549089c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-cb4f582c-5e8f-48b8-987c-39d27549089c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-cb4f582c-5e8f-48b8-987c-39d27549089c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-cb4f582c-5e8f-48b8-987c-39d27549089c" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d3f08-af15-4f5e-8349-d41834f61044]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:18 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173da206-5d70-4c8f-bbd4-c3a3ed3b5d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda20f45-9620-4b8e-a4e9-4194bfd45695', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a8838d-8b7a-415a-ba59-26a151f6a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Volume volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 (dda20f45-9620-4b8e-a4e9-4194bfd45695): created successfully Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a8838d-8b7a-415a-ba59-26a151f6a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Flow 'volume_create_manager' (304e0918-3a06-4add-8dc3-759d3f7f0757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:18 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c Jul 09 16:42:18 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cdf858e7-9586-4fcd-a58a-5edfa767c81b tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Created volume successfully. Jul 09 16:42:19 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.774s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Deleted volume successfully. Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-175b2c2e-731c-4737-8cfb-8b8685e43d38 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-a58c9abe-7618-4169-9673-678f1055c1d5-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:19 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d" returned: 0 in 0.968s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1feb722c-5994-40e4-9bc2-ee1c62d77927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:19 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 Jul 09 16:42:19 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:19 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c" returned: 0 in 0.935s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:19 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c Jul 09 16:42:19 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:19 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075" returned: 0 in 0.834s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:19 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075 Jul 09 16:42:19 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:20 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb4f582c-5e8f-48b8-987c-39d27549089c" returned: 0 in 0.674s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-cb4f582c-5e8f-48b8-987c-39d27549089c" released by "delete_volume" :: held 1.654s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Created reservations ['fda91c07-bf08-4a3e-8f88-b07e3927f0af', 'd5891bb7-8226-4a72-89d5-25285208d340', '6da0b54a-dba7-455a-9d38-5b5d68f2bbc9', 'c7d71fd0-7e0a-41a6-81cf-c5764e9aefe1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:20 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:20 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-abcabbfd-273f-4ae3-8c08-309d4ccb8de9-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-abcabbfd-273f-4ae3-8c08-309d4ccb8de9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-abcabbfd-273f-4ae3-8c08-309d4ccb8de9" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-abcabbfd-273f-4ae3-8c08-309d4ccb8de9" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[19879d6c-4a89-4acc-94f7-9485aca2ca7d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:20 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.a3c7e280-4046-45f9-87bc-dc538178c075" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-a3c7e280-4046-45f9-87bc-dc538178c075" released by "_delete_snapshot" :: held 3.749s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" released by "delete_snapshot" :: held 3.786s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:20 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 Jul 09 16:42:20 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Created reservations ['7c04de13-c32c-4d18-a2b6-d6e324cab60b', '8b25ff81-aaae-4015-87dd-56f9ca3a1d26', '8a5b8fb0-0e43-4bd5-95db-f67711945f8b', '6951b772-05b7-46f1-aba9-ddda55b64fbf'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:20 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:20 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Deleted volume successfully. Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3a8f3409-061e-4827-82de-81fb4074ebf7 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-cb4f582c-5e8f-48b8-987c-39d27549089c-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Delete snapshot completed successfully. Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-a3c7e280-4046-45f9-87bc-dc538178c075-delete_snapshot" released by "delete_snapshot" :: held 4.034s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-d51cea8a-f258-4795-b59c-3231d688d07d-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-d51cea8a-f258-4795-b59c-3231d688d07d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-d51cea8a-f258-4795-b59c-3231d688d07d" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-d51cea8a-f258-4795-b59c-3231d688d07d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Deleting offline snapshot d51cea8a-f258-4795-b59c-3231d688d07d of volume 1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] snapshot_file for this snap is: volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9393f80c-d487-42df-b6c3-b9df5e5b09cc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:21 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d Jul 09 16:42:21 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:21 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9" returned: 0 in 0.936s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:21 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9 Jul 09 16:42:21 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:22 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d" returned: 0 in 0.892s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1feb722c-5994-40e4-9bc2-ee1c62d77927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b2613-e80b-426b-9b63-8b2fd863202c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:22 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 Jul 09 16:42:22 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5d240083-040d-4a51-aa61-4c098b4e93a3 req-81607846-e097-4a9c-bd2d-ed3371bfe00c tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5d240083-040d-4a51-aa61-4c098b4e93a3 req-81607846-e097-4a9c-bd2d-ed3371bfe00c tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d547ef-7bd3-46d9-bac0-2194304f0e37]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5d240083-040d-4a51-aa61-4c098b4e93a3 req-81607846-e097-4a9c-bd2d-ed3371bfe00c tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:22 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-abcabbfd-273f-4ae3-8c08-309d4ccb8de9" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-abcabbfd-273f-4ae3-8c08-309d4ccb8de9" released by "delete_volume" :: held 1.855s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:22 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 Jul 09 16:42:22 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Created reservations ['825282bf-fefb-4f53-8610-de8d1dd9d695', '0763a510-46cb-42e7-812d-91b4e3d60203', 'fbc0cdf0-0dc8-40c0-b85f-2835020b4cb1', '760fb7f7-5339-40a4-838a-ae31c68d241a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:22 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:22 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7465523d-008c-45f6-bcb4-2d322aab7494]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:23 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:23 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d Jul 09 16:42:23 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:23 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe Jul 09 16:42:23 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:23 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5d240083-040d-4a51-aa61-4c098b4e93a3 req-81607846-e097-4a9c-bd2d-ed3371bfe00c tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695" returned: 0 in 1.134s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5d240083-040d-4a51-aa61-4c098b4e93a3 req-81607846-e097-4a9c-bd2d-ed3371bfe00c tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.162s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-5d240083-040d-4a51-aa61-4c098b4e93a3 req-81607846-e097-4a9c-bd2d-ed3371bfe00c tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-dda20f45-9620-4b8e-a4e9-4194bfd45695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbf2ba2e-57a0-4a92-b120-56127cf3e5d8', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:42:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-5d240083-040d-4a51-aa61-4c098b4e93a3 req-81607846-e097-4a9c-bd2d-ed3371bfe00c tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] attachment_update completed successfully. Jul 09 16:42:23 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.082s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Deleted volume successfully. Jul 09 16:42:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-140ea5a8-0568-448a-bbd9-f4559360d87b tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-abcabbfd-273f-4ae3-8c08-309d4ccb8de9-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:24 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d" returned: 0 in 1.050s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:24 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d Jul 09 16:42:24 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:24 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe" returned: 0 in 1.173s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:24 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe Jul 09 16:42:24 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:24 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927.d51cea8a-f258-4795-b59c-3231d688d07d" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:25 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-d51cea8a-f258-4795-b59c-3231d688d07d" released by "_delete_snapshot" :: held 3.893s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe" released by "delete_volume" :: held 1.933s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" released by "delete_snapshot" :: held 3.934s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Created reservations ['fa0d569a-ea60-42f6-a8b8-6466b551557f', '24516aa9-d4bd-48d5-ad7d-786cc08ac529', 'f0c4d44e-b35e-46ef-8d74-6b358c5c2b83', '089f6fed-b8ff-4c97-8368-20f0599cc388'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Created reservations ['16cb9427-d1b8-4979-b465-c9a97971e550', '0073903b-f1a6-48dc-9548-a212c01d53b0', '9a2d64f8-a038-4c92-b261-17dd395f03a0', '41525b22-c5ff-4529-ab3f-14c3616ff429'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:25 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:25 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Delete snapshot completed successfully. Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-d51cea8a-f258-4795-b59c-3231d688d07d-delete_snapshot" released by "delete_snapshot" :: held 4.176s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Snapshots deleted, issuing volume delete {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-909f3b70-f749-43d7-bc97-01a1c14faca1-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfceaff-3536-422a-852f-ed9a6b50dbe6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-909f3b70-f749-43d7-bc97-01a1c14faca1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-e078af4c-73fc-476d-a61d-7d7619804601" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-e078af4c-73fc-476d-a61d-7d7619804601" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-909f3b70-f749-43d7-bc97-01a1c14faca1" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-909f3b70-f749-43d7-bc97-01a1c14faca1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Deleting offline snapshot 909f3b70-f749-43d7-bc97-01a1c14faca1 of volume e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] snapshot_file for this snap is: volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[56844618-3a21-4387-92ca-562b1dd93fe7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:25 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 Jul 09 16:42:25 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:25 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 Jul 09 16:42:25 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:25 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Deleted volume successfully. Jul 09 16:42:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b3edd35d-70fa-4326-8c9c-2e36c6bdbe7e tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-dd5b3ab9-a5cf-4866-a6d3-4ba7246283fe-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:26 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927" returned: 0 in 0.882s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:26 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927 Jul 09 16:42:26 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:26 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1" returned: 0 in 0.900s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e078af4c-73fc-476d-a61d-7d7619804601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797424c-1923-450f-8ced-17344e2cd5e1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:26 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 Jul 09 16:42:26 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:26 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1feb722c-5994-40e4-9bc2-ee1c62d77927" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-1feb722c-5994-40e4-9bc2-ee1c62d77927" released by "delete_volume" :: held 1.669s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:26 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Created reservations ['1b2f3e39-50ed-40d2-abb1-eecd98887ff9', 'f38621aa-1314-402d-a648-f1d46069be77', 'd81f29c9-e4af-402e-be00-6e0d9f630b30', '0b40e8a0-dc7d-4192-b142-6c5e1f194bd7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:27 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:27 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:27 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601" returned: 0 in 0.846s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:27 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 Jul 09 16:42:27 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:27 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Deleted volume successfully. Jul 09 16:42:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-25e56d92-becb-43a8-8794-9a221726e74e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-1feb722c-5994-40e4-9bc2-ee1c62d77927-delete_volume" released by "delete_volume" :: held 10.877s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:28 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:28 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1 Jul 09 16:42:28 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Flow 'volume_create_manager' (bde04a4b-0f73-4e13-b1c3-49497d63bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84780f35-022f-469b-9c5e-f34ad46eb372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84780f35-022f-469b-9c5e-f34ad46eb372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1019502347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6731902b-d1e7-4aa6-a477-6ebb07d67a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290862678d2a4dd2a949f0f927d1d6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:28Z,use_quota=True,user_id='1dec436155c449289ec1750783cf3d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2f25c7-d17a-47da-9b24-67adcf00f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2f25c7-d17a-47da-9b24-67adcf00f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53644289-c3c2-4f38-97cf-2bded2c82061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53644289-c3c2-4f38-97cf-2bded2c82061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6731902b-d1e7-4aa6-a477-6ebb07d67a71', 'volume_name': 'volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1132698e-8ade-45ca-8d5c-944e761079ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1132698e-8ade-45ca-8d5c-944e761079ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288c7990-63dc-4ade-a82e-ef2419510d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Volume 6731902b-d1e7-4aa6-a477-6ebb07d67a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71', 'volume_size': 1} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1019502347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6731902b-d1e7-4aa6-a477-6ebb07d67a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290862678d2a4dd2a949f0f927d1d6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:28Z,use_quota=True,user_id='1dec436155c449289ec1750783cf3d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Creating volume 6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:28 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:28 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 1073741824 Jul 09 16:42:28 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:28 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601.909f3b70-f749-43d7-bc97-01a1c14faca1" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-909f3b70-f749-43d7-bc97-01a1c14faca1" released by "_delete_snapshot" :: held 3.388s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-e078af4c-73fc-476d-a61d-7d7619804601" released by "delete_snapshot" :: held 3.415s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:28 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:28 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Created reservations ['e3336df3-11a6-41df-b5ed-a86780464257', '4403d00f-dd50-4594-b731-e0df04c9e67d', '20cf83e5-9969-4b81-8ea4-3fe15375a862', '404befb1-d42f-4481-9a5a-3ad91ba809b4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Delete snapshot completed successfully. Jul 09 16:42:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7045a44c-3b82-433b-8f96-50b3cabadb29 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-909f3b70-f749-43d7-bc97-01a1c14faca1-delete_snapshot" released by "delete_snapshot" :: held 3.622s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:29 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-e078af4c-73fc-476d-a61d-7d7619804601-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-e078af4c-73fc-476d-a61d-7d7619804601-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "cinder-quobyte-e078af4c-73fc-476d-a61d-7d7619804601" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-e078af4c-73fc-476d-a61d-7d7619804601" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:29 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 1073741824" returned: 0 in 1.173s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef631e5-4740-4b76-bae2-34cc61cd1ab1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:29 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 Jul 09 16:42:29 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:30 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 Jul 09 16:42:30 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:30 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:30 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71" returned: 0 in 0.875s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:30 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601 Jul 09 16:42:30 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288c7990-63dc-4ade-a82e-ef2419510d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16aeb72c-fb0d-4334-b9b6-14d32f8e8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Volume volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 (6731902b-d1e7-4aa6-a477-6ebb07d67a71): created successfully Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16aeb72c-fb0d-4334-b9b6-14d32f8e8477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Flow 'volume_create_manager' (bde04a4b-0f73-4e13-b1c3-49497d63bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f07a37b2-3042-4e10-bbea-9a28abef99b7 tempest-VolumesDeleteCascade-1770368608 None] Created volume successfully. Jul 09 16:42:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-f6bb99b9-4b2c-42f8-8b77-51da6a5e9b79 req-6781f285-3df6-41b5-97de-dfb0b4b1f070 tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Terminate volume connection completed successfully. Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-f6bb99b9-4b2c-42f8-8b77-51da6a5e9b79 req-6781f285-3df6-41b5-97de-dfb0b4b1f070 tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Deleting attachment cbf2ba2e-57a0-4a92-b120-56127cf3e5d8. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:42:31 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e078af4c-73fc-476d-a61d-7d7619804601" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-quobyte-e078af4c-73fc-476d-a61d-7d7619804601" released by "delete_volume" :: held 1.828s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Created reservations ['c1192a6c-2cf3-4168-876e-df0edc76154a', '15297c03-c569-4f78-aa52-ef84a1a65454', '38c38dae-fee8-4800-8e63-8f01783fe1ec', 'a7db1052-bdc0-43f4-9cd4-3b35e757ed8f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:31 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:31 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Creating offline snapshot 819adfa8-65db-4d50-a87a-507bfe230735 of volume 6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e8386-c340-43bf-b076-fcb0a5cf2d4c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:32 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 Jul 09 16:42:32 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:32 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.949s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Deleted volume successfully. Jul 09 16:42:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bb9cd775-f9d7-4a67-905e-6e47a0c90452 tempest-CreateVolumesFromSnapshotTest-53996244 None] Lock "cinder-e078af4c-73fc-476d-a61d-7d7619804601-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:33 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71" returned: 0 in 0.929s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:33 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 1G Jul 09 16:42:33 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Acquiring lock "cinder-dda20f45-9620-4b8e-a4e9-4194bfd45695-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "cinder-dda20f45-9620-4b8e-a4e9-4194bfd45695-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Acquiring lock "cinder-quobyte-dda20f45-9620-4b8e-a4e9-4194bfd45695" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "cinder-quobyte-dda20f45-9620-4b8e-a4e9-4194bfd45695" acquired by "delete_volume" :: waited 0.047s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fccb6b-2d8a-405c-a429-007cf23b8ed7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:33 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 Jul 09 16:42:33 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:34 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 1G" returned: 0 in 1.091s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:34 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 Jul 09 16:42:34 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:34 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695" returned: 0 in 0.879s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:34 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695 Jul 09 16:42:34 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:35 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:35 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 is being set with open permissions: ugo+rw Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:35 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 Jul 09 16:42:35 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:35 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-dda20f45-9620-4b8e-a4e9-4194bfd45695" returned: 0 in 0.850s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "cinder-quobyte-dda20f45-9620-4b8e-a4e9-4194bfd45695" released by "delete_volume" :: held 1.804s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Created reservations ['fb7ed51d-76ba-4a01-8e07-a7bf1ef8acbb', 'd93a3628-1444-45f9-85ed-cede0afbd02f', 'a0f05e92-9a2e-444d-ada5-8e815ef39ab7', '4c9e8ec2-57e3-40f3-99df-a023aed70d32'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:35 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:42:35 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:36 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735" returned: 0 in 0.957s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:36 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.info Jul 09 16:42:36 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:36 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.207s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:42:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Deleted volume successfully. Jul 09 16:42:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1104ca00-afcc-49d1-a596-2b3044bc05ee tempest-TestServerVolumeAttachScenarioOldVersion-1069084000 None] Lock "cinder-dda20f45-9620-4b8e-a4e9-4194bfd45695-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:37 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.info" returned: 0 in 1.191s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:37 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.info is being set with open permissions: ugo+rw Jul 09 16:42:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:37 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.info Jul 09 16:42:37 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:38 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.info" returned: 0 in 0.962s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.314s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d41381e0-1b49-404d-a043-6f961015cd2c tempest-VolumesDeleteCascade-1770368608 None] Create snapshot completed successfully Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Flow 'volume_create_manager' (28493ca2-7e8b-48be-933a-f9fd49caeb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00728f33-daad-4a39-96ec-91ca94cd98fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00728f33-daad-4a39-96ec-91ca94cd98fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0572f4cc-4736-4989-b978-77b610ddc0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16b091d189b4e368e0c4f68e0067251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:40Z,use_quota=True,user_id='26f719cce48941e1a325b257e7e212d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2812ab0-c8c0-4716-a8cd-e02dd2cb1f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2812ab0-c8c0-4716-a8cd-e02dd2cb1f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db61f2cd-dc6c-4cbf-a312-975d2cffe145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:39 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db61f2cd-dc6c-4cbf-a312-975d2cffe145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0572f4cc-4736-4989-b978-77b610ddc0aa', 'volume_name': 'volume-0572f4cc-4736-4989-b978-77b610ddc0aa', 'volume_size': 1, 'image_id': '69979367-79a9-4dd7-8569-15bbbd56e8ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69979367-79a9-4dd7-8569-15bbbd56e8ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fdca93ee2c4c62c867d90a379b53f09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f16b091d189b4e368e0c4f68e0067251', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa8be8a66a36e90027b103179e863cc65e4987714c9181d0fb1a469dcafa348fc9a751dfb9a6e4f0b7f2e8d65e30a59ff93eb12896a889e1accf9b8b5393ce6d', 'id': '69979367-79a9-4dd7-8569-15bbbd56e8ce', 'created_at': datetime.datetime(2026, 7, 9, 14, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69979367-79a9-4dd7-8569-15bbbd56e8ce/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b2b3a0-1320-442f-ba68-257cf839980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b2b3a0-1320-442f-ba68-257cf839980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25935ea1-fb5f-4222-adf7-0582d456dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Volume 0572f4cc-4736-4989-b978-77b610ddc0aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0572f4cc-4736-4989-b978-77b610ddc0aa', 'volume_size': 1, 'image_id': '69979367-79a9-4dd7-8569-15bbbd56e8ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69979367-79a9-4dd7-8569-15bbbd56e8ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fdca93ee2c4c62c867d90a379b53f09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f16b091d189b4e368e0c4f68e0067251', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa8be8a66a36e90027b103179e863cc65e4987714c9181d0fb1a469dcafa348fc9a751dfb9a6e4f0b7f2e8d65e30a59ff93eb12896a889e1accf9b8b5393ce6d', 'id': '69979367-79a9-4dd7-8569-15bbbd56e8ce', 'created_at': datetime.datetime(2026, 7, 9, 14, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69979367-79a9-4dd7-8569-15bbbd56e8ce/file', 'properties': {}}, 'image_service': } Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Trying to clone 0572f4cc-4736-4989-b978-77b610ddc0aa from image 69979367-79a9-4dd7-8569-15bbbd56e8ce at location (None, [{'url': 'file:///opt/stack/data/glance/images/69979367-79a9-4dd7-8569-15bbbd56e8ce', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:42:40 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Image download 0.00 MB at 0.00 MB/s Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c11850-2965-4fba-ac2d-802704c40315]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:42:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Flow 'volume_create_manager' (acb4ea2c-a089-43f3-9ce5-dc31d9c3fe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a56b15-cbeb-4b05-9b83-80bb9bc93d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a56b15-cbeb-4b05-9b83-80bb9bc93d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1604428594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287c9b29-eab0-4bc9-8062-0955fc66e3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290862678d2a4dd2a949f0f927d1d6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=819adfa8-65db-4d50-a87a-507bfe230735,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:41Z,use_quota=True,user_id='1dec436155c449289ec1750783cf3d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae22140a-33ed-4dbc-b332-61b0c5065ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae22140a-33ed-4dbc-b332-61b0c5065ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dbb306-3887-49d3-9c5f-1d3956f07cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dbb306-3887-49d3-9c5f-1d3956f07cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '287c9b29-eab0-4bc9-8062-0955fc66e3e2', 'volume_name': 'volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2', 'volume_size': 1, 'snapshot_id': '819adfa8-65db-4d50-a87a-507bfe230735'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:41 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e23fa2-b908-45f1-8535-bc40f5e65f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:41 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e23fa2-b908-45f1-8535-bc40f5e65f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0243038-6242-489e-9d46-b1910e98f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Volume 287c9b29-eab0-4bc9-8062-0955fc66e3e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2', 'volume_size': 1, 'snapshot_id': '819adfa8-65db-4d50-a87a-507bfe230735'} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-819adfa8-65db-4d50-a87a-507bfe230735-287c9b29-eab0-4bc9-8062-0955fc66e3e2" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-819adfa8-65db-4d50-a87a-507bfe230735-287c9b29-eab0-4bc9-8062-0955fc66e3e2" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Creating volume 287c9b29-eab0-4bc9-8062-0955fc66e3e2 from snapshot 819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-287c9b29-eab0-4bc9-8062-0955fc66e3e2" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-287c9b29-eab0-4bc9-8062-0955fc66e3e2" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] snapshot: 819adfa8-65db-4d50-a87a-507bfe230735, volume: 287c9b29-eab0-4bc9-8062-0955fc66e3e2, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[09316d6b-e9c2-46a7-b3b6-ef8c37d07c18]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:41 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 Jul 09 16:42:41 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:42 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD" returned: 0 in 1.354s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:42 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD Jul 09 16:42:42 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:42 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735" returned: 0 in 1.589s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:42:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:42:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:42:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa84a47e-cad7-45f6-b166-589d20489924]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:43 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 Jul 09 16:42:43 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:43 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD" returned: 1 in 1.113s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:42:43 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Temporary image 69979367-79a9-4dd7-8569-15bbbd56e8ce is fetched for user 26f719cce48941e1a325b257e7e212d6. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:42:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c3554-0227-4b0c-bfca-d0105fd1941d]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:43 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD Jul 09 16:42:43 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:44 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD" returned: 0 in 1.217s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:44 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71" returned: 0 in 1.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:44 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:42:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:44 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 Jul 09 16:42:44 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:44 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD Jul 09 16:42:44 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:46 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD" returned: 1 in 1.254s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:42:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:51 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2" returned: 0 in 6.434s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67572c8-18e0-4ced-b670-458f3ffcd2be]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:51 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 Jul 09 16:42:51 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:52 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71" returned: 0 in 1.134s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:52 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:42:52 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Converted 1024.00 MB image at 159.13 MB/s Jul 09 16:42:52 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 is being set with open permissions: ugo+rw Jul 09 16:42:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:52 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 Jul 09 16:42:52 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:53 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2" returned: 0 in 0.758s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-287c9b29-eab0-4bc9-8062-0955fc66e3e2" released by "_copy_volume_from_snapshot" :: held 11.982s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-819adfa8-65db-4d50-a87a-507bfe230735-287c9b29-eab0-4bc9-8062-0955fc66e3e2" released by "_create_volume_from_snapshot" :: held 12.060s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.099s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.174s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0572f4cc-4736-4989-b978-77b610ddc0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16b091d189b4e368e0c4f68e0067251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:42:40Z,use_quota=True,user_id='26f719cce48941e1a325b257e7e212d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Creating volume 0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:42:53 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=115,cinder:SELECT=91,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:42:53 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa 1073741824 Jul 09 16:42:53 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0243038-6242-489e-9d46-b1910e98f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2', 'volume_size': 1, 'snapshot_id': '819adfa8-65db-4d50-a87a-507bfe230735'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d41a7a5-3e72-4e87-ad07-196da784984a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:42:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Volume volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 (287c9b29-eab0-4bc9-8062-0955fc66e3e2): created successfully Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d41a7a5-3e72-4e87-ad07-196da784984a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:42:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Flow 'volume_create_manager' (acb4ea2c-a089-43f3-9ce5-dc31d9c3fe0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:42:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d7b27404-5d2a-4003-94f9-ed1a7803e724 tempest-VolumesDeleteCascade-1770368608 None] Created volume successfully. Jul 09 16:42:54 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa 1073741824" returned: 0 in 1.066s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:54 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa Jul 09 16:42:54 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-6731902b-d1e7-4aa6-a477-6ebb07d67a71-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-6731902b-d1e7-4aa6-a477-6ebb07d67a71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Performing cascade delete. {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-819adfa8-65db-4d50-a87a-507bfe230735-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-819adfa8-65db-4d50-a87a-507bfe230735-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-6731902b-d1e7-4aa6-a477-6ebb07d67a71" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-6731902b-d1e7-4aa6-a477-6ebb07d67a71" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-819adfa8-65db-4d50-a87a-507bfe230735" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-819adfa8-65db-4d50-a87a-507bfe230735" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Deleting offline snapshot 819adfa8-65db-4d50-a87a-507bfe230735 of volume 6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] snapshot_file for this snap is: volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd0f184-ace3-44cd-a5ef-5b4d640ad3c9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:54 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 Jul 09 16:42:54 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:55 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Attempting download of 69979367-79a9-4dd7-8569-15bbbd56e8ce ((None, [{'url': 'file:///opt/stack/data/glance/images/69979367-79a9-4dd7-8569-15bbbd56e8ce', 'metadata': {}}])) to volume 0572f4cc-4736-4989-b978-77b610ddc0aa. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df35f4-4cce-4593-8ac4-f51411330629]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69979367-79a9-4dd7-8569-15bbbd56e8ce_smnz3p_w {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:55 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69979367-79a9-4dd7-8569-15bbbd56e8ce_smnz3p_w Jul 09 16:42:55 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:55 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eef3c07-fe55-450a-8817-3c96cc726914]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:55 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 Jul 09 16:42:55 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:56 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69979367-79a9-4dd7-8569-15bbbd56e8ce_smnz3p_w" returned: 0 in 0.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69979367-79a9-4dd7-8569-15bbbd56e8ce_smnz3p_w {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:56 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69979367-79a9-4dd7-8569-15bbbd56e8ce_smnz3p_w Jul 09 16:42:56 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:56 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:56 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 Jul 09 16:42:56 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:56 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69979367-79a9-4dd7-8569-15bbbd56e8ce_smnz3p_w" returned: 1 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69979367-79a9-4dd7-8569-15bbbd56e8ce_smnz3p_w' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58db4db-3c56-4033-a8bc-354e392e087a]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:56 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD Jul 09 16:42:56 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:57 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735" returned: 0 in 0.861s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:57 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735 Jul 09 16:42:57 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:57 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:57 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD Jul 09 16:42:57 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:58 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71.819adfa8-65db-4d50-a87a-507bfe230735" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-819adfa8-65db-4d50-a87a-507bfe230735" released by "_delete_snapshot" :: held 3.465s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-6731902b-d1e7-4aa6-a477-6ebb07d67a71" released by "delete_snapshot" :: held 3.495s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Created reservations ['6c65558a-af54-4d5b-9351-ffcfd6c245c2', 'a9d78dc3-4a62-4d53-86a3-b100335fef67', '115afb6b-8002-401d-9f10-0b1fb0bf5593', 'e3f5a3c4-a0cf-4a33-bdd7-298fbd1a473f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:42:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Delete snapshot completed successfully. Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-819adfa8-65db-4d50-a87a-507bfe230735-delete_snapshot" released by "delete_snapshot" :: held 3.664s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Snapshots deleted, issuing volume delete {{(pid=87204) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-6731902b-d1e7-4aa6-a477-6ebb07d67a71" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-6731902b-d1e7-4aa6-a477-6ebb07d67a71" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:42:58 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] 69979367-79a9-4dd7-8569-15bbbd56e8ce was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b8052a-5b1b-4556-9ce2-d2a4a8d857a6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:42:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:58 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa Jul 09 16:42:58 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:58 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 Jul 09 16:42:58 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:59 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa" returned: 0 in 0.801s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:59 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69979367-79a9-4dd7-8569-15bbbd56e8ce_wv2n9_khdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:42:59 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 16:42:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:59 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71" returned: 0 in 0.807s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:42:59 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa 1G Jul 09 16:42:59 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:59 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71 Jul 09 16:42:59 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:42:59 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 09 16:42:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6731902b-d1e7-4aa6-a477-6ebb07d67a71" returned: 0 in 0.734s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:42:59 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa 1G" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-6731902b-d1e7-4aa6-a477-6ebb07d67a71" released by "delete_volume" :: held 1.649s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b9e21-46b4-41f8-9067-275cc70fcee9]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Created reservations ['d9dffe90-570a-49b2-8dda-1b7cb1864086', 'd952c591-b5db-4702-aba0-086ab0b9010d', 'acc12fa1-e813-4565-a4f6-5dd0bd9613dc', '494f3363-05b7-4816-bbee-7b757232ce5b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:00 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa Jul 09 16:43:00 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:00 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:43:00 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:00 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa" returned: 0 in 0.813s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:00 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa Jul 09 16:43:00 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:01 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:43:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Deleted volume successfully. Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff039f1b-d180-437d-a150-c610d9434c3e tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-6731902b-d1e7-4aa6-a477-6ebb07d67a71-delete_volume" released by "delete_volume" :: held 6.486s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-287c9b29-eab0-4bc9-8062-0955fc66e3e2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-287c9b29-eab0-4bc9-8062-0955fc66e3e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "cinder-quobyte-287c9b29-eab0-4bc9-8062-0955fc66e3e2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-287c9b29-eab0-4bc9-8062-0955fc66e3e2" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[044e66d5-3dc7-478a-849e-099bcf5e64a6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:01 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 Jul 09 16:43:01 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:01 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa" returned: 1 in 1.072s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Downloaded image 69979367-79a9-4dd7-8569-15bbbd56e8ce ((None, [{'url': 'file:///opt/stack/data/glance/images/69979367-79a9-4dd7-8569-15bbbd56e8ce', 'metadata': {}}])) to volume 0572f4cc-4736-4989-b978-77b610ddc0aa successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Temporary image 69979367-79a9-4dd7-8569-15bbbd56e8ce for user 26f719cce48941e1a325b257e7e212d6 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Marking volume 0572f4cc-4736-4989-b978-77b610ddc0aa as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Copying metadata from image 69979367-79a9-4dd7-8569-15bbbd56e8ce to 0572f4cc-4736-4989-b978-77b610ddc0aa. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:43:01 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Creating volume glance metadata for volume 0572f4cc-4736-4989-b978-77b610ddc0aa backed by image 69979367-79a9-4dd7-8569-15bbbd56e8ce with: {'image_id': '69979367-79a9-4dd7-8569-15bbbd56e8ce', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5fdca93ee2c4c62c867d90a379b53f09', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:43:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25935ea1-fb5f-4222-adf7-0582d456dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0572f4cc-4736-4989-b978-77b610ddc0aa', 'volume_size': 1, 'image_id': '69979367-79a9-4dd7-8569-15bbbd56e8ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69979367-79a9-4dd7-8569-15bbbd56e8ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fdca93ee2c4c62c867d90a379b53f09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f16b091d189b4e368e0c4f68e0067251', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aa8be8a66a36e90027b103179e863cc65e4987714c9181d0fb1a469dcafa348fc9a751dfb9a6e4f0b7f2e8d65e30a59ff93eb12896a889e1accf9b8b5393ce6d', 'id': '69979367-79a9-4dd7-8569-15bbbd56e8ce', 'created_at': datetime.datetime(2026, 7, 9, 14, 42, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69979367-79a9-4dd7-8569-15bbbd56e8ce/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e0394e-bfc5-4115-b904-6d5bc8345225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Volume volume-0572f4cc-4736-4989-b978-77b610ddc0aa (0572f4cc-4736-4989-b978-77b610ddc0aa): created successfully Jul 09 16:43:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e0394e-bfc5-4115-b904-6d5bc8345225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Flow 'volume_create_manager' (28493ca2-7e8b-48be-933a-f9fd49caeb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c02159e3-32c2-4135-9b1e-14f0a9989814 tempest-VolumeImageDependencyTests-546751565 None] Created volume successfully. Jul 09 16:43:02 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2" returned: 0 in 0.902s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:02 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2 Jul 09 16:43:02 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Acquiring lock "cinder-0572f4cc-4736-4989-b978-77b610ddc0aa-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Lock "cinder-0572f4cc-4736-4989-b978-77b610ddc0aa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:03 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-287c9b29-eab0-4bc9-8062-0955fc66e3e2" returned: 0 in 0.819s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Acquiring lock "cinder-quobyte-0572f4cc-4736-4989-b978-77b610ddc0aa" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-quobyte-287c9b29-eab0-4bc9-8062-0955fc66e3e2" released by "delete_volume" :: held 1.794s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Lock "cinder-quobyte-0572f4cc-4736-4989-b978-77b610ddc0aa" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b934e4-6c1c-4c73-8c7b-bdfaecd95396]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Created reservations ['bad7a509-2a22-4b63-8f21-4d438e0f4096', 'cafc40f3-578d-4434-9f23-0b8fa537cbbb', '9e257cc3-0d4f-4098-99d0-32774a202645', '3c47b656-554d-4f78-91a0-fff23a9218c8'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:43:03 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa Jul 09 16:43:03 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:03 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:43:03 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:04 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa" returned: 0 in 1.103s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:04 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.974s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:04 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:43:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Deleted volume successfully. Jul 09 16:43:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0370fe10-fd2a-4c75-9a26-fb6c570005e4 tempest-VolumesDeleteCascade-1770368608 None] Lock "cinder-287c9b29-eab0-4bc9-8062-0955fc66e3e2-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:04 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa Jul 09 16:43:04 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Flow 'volume_create_manager' (4d4b63c0-ae02-4eba-8d4e-cd440d3ff569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f48a3d-db45-42d4-b0c5-ec1bab95806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f48a3d-db45-42d4-b0c5-ec1bab95806d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070848445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af05cc19-ee3a-4af2-ada9-3f7698946324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846071918c414d82b8aa5f52c51db66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:05Z,use_quota=True,user_id='41f2d74f7a8043adb12e1895ee4f8282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1da201f-5d77-4a6e-a0c8-d1b26daf64ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1da201f-5d77-4a6e-a0c8-d1b26daf64ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb9df04-c955-49e3-b650-87f5f6b6b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb9df04-c955-49e3-b650-87f5f6b6b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af05cc19-ee3a-4af2-ada9-3f7698946324', 'volume_name': 'volume-af05cc19-ee3a-4af2-ada9-3f7698946324', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0903b8-39fb-4950-895e-12ec083f92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0903b8-39fb-4950-895e-12ec083f92e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8373031f-49c8-444f-85a1-21622bee7284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Volume af05cc19-ee3a-4af2-ada9-3f7698946324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af05cc19-ee3a-4af2-ada9-3f7698946324', 'volume_size': 1} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2070848445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af05cc19-ee3a-4af2-ada9-3f7698946324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846071918c414d82b8aa5f52c51db66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:05Z,use_quota=True,user_id='41f2d74f7a8043adb12e1895ee4f8282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Creating volume af05cc19-ee3a-4af2-ada9-3f7698946324 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:43:05 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:05 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 1073741824 Jul 09 16:43:05 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:05 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa" returned: 1 in 1.112s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:43:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:05 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa Jul 09 16:43:05 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:06 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0572f4cc-4736-4989-b978-77b610ddc0aa" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Lock "cinder-quobyte-0572f4cc-4736-4989-b978-77b610ddc0aa" released by "delete_volume" :: held 3.224s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Created reservations ['795a0458-9d70-498f-be0d-4d53fb7867ad', 'bc5cdb83-d9c7-472d-a871-c3d40b34682c', 'e4675fcd-f580-4913-bd17-b2d908bbdfd8', '63bb34a5-475f-49dc-b27c-fafe84a8c1a7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:06 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:43:06 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:06 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 1073741824" returned: 0 in 1.435s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:06 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 Jul 09 16:43:06 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:07 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.119s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:07 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:43:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Deleted volume successfully. Jul 09 16:43:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-57ce0deb-389b-484d-85a9-65e49e394e6f tempest-VolumeImageDependencyTests-546751565 None] Lock "cinder-0572f4cc-4736-4989-b978-77b610ddc0aa-delete_volume" released by "delete_volume" :: held 4.679s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:08 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324" returned: 0 in 1.174s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] <== create_volume: return (2677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:43:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.679s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8373031f-49c8-444f-85a1-21622bee7284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af05cc19-ee3a-4af2-ada9-3f7698946324', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269a2a1c-38bc-46eb-bcd4-4c7b030972e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Volume volume-af05cc19-ee3a-4af2-ada9-3f7698946324 (af05cc19-ee3a-4af2-ada9-3f7698946324): created successfully Jul 09 16:43:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269a2a1c-38bc-46eb-bcd4-4c7b030972e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Flow 'volume_create_manager' (4d4b63c0-ae02-4eba-8d4e-cd440d3ff569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-54c9365c-029b-474a-bbb4-2bd860921f4d tempest-AttachVolumeTestJSON-1630178730 None] Created volume successfully. Jul 09 16:43:12 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=135,cinder:DELETE=6,cinder:INSERT=37,cinder:SELECT=106 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:43:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac02e5b0-3bf9-485e-ad6a-67de7745228d req-3a2e4ff2-e30b-422e-b431-e6f6706ab329 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac02e5b0-3bf9-485e-ad6a-67de7745228d req-3a2e4ff2-e30b-422e-b431-e6f6706ab329 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233f950-f9b6-41e8-8ff0-ec3dca99d182]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-ac02e5b0-3bf9-485e-ad6a-67de7745228d req-3a2e4ff2-e30b-422e-b431-e6f6706ab329 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:12 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 Jul 09 16:43:12 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:13 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-ac02e5b0-3bf9-485e-ad6a-67de7745228d req-3a2e4ff2-e30b-422e-b431-e6f6706ab329 tempest-AttachVolumeTestJSON-1630178730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324" returned: 0 in 1.152s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-ac02e5b0-3bf9-485e-ad6a-67de7745228d req-3a2e4ff2-e30b-422e-b431-e6f6706ab329 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.182s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-ac02e5b0-3bf9-485e-ad6a-67de7745228d req-3a2e4ff2-e30b-422e-b431-e6f6706ab329 tempest-AttachVolumeTestJSON-1630178730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-af05cc19-ee3a-4af2-ada9-3f7698946324', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c590c1ac-5447-4efe-9140-718ac61b7cb6', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:43:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-ac02e5b0-3bf9-485e-ad6a-67de7745228d req-3a2e4ff2-e30b-422e-b431-e6f6706ab329 tempest-AttachVolumeTestJSON-1630178730 None] attachment_update completed successfully. Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Flow 'volume_create_manager' (85771b0e-dfaf-4a6d-b09b-812cdefe2ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e38a23-8437-4f14-a6ae-ccbd72961421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e38a23-8437-4f14-a6ae-ccbd72961421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1273237372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846071918c414d82b8aa5f52c51db66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:19Z,use_quota=True,user_id='41f2d74f7a8043adb12e1895ee4f8282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fda578-9a0e-4132-b7f3-b8e6d2ca267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fda578-9a0e-4132-b7f3-b8e6d2ca267f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f8901f-0da0-4b6f-81d2-6f4635822597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f8901f-0da0-4b6f-81d2-6f4635822597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e', 'volume_name': 'volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fa325d-b8eb-4070-9102-137572793db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fa325d-b8eb-4070-9102-137572793db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d514ccb4-0a65-468e-af96-bedc02e426aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Volume 1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e', 'volume_size': 1} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1273237372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846071918c414d82b8aa5f52c51db66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:19Z,use_quota=True,user_id='41f2d74f7a8043adb12e1895ee4f8282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Creating volume 1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:43:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:43:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:19 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e 1073741824 Jul 09 16:43:19 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:20 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e 1073741824" returned: 0 in 1.025s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:20 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e Jul 09 16:43:20 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:21 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:43:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d514ccb4-0a65-468e-af96-bedc02e426aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1db9ba-3901-440f-aee4-931fa89dc5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Volume volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e (1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e): created successfully Jul 09 16:43:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1db9ba-3901-440f-aee4-931fa89dc5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Flow 'volume_create_manager' (85771b0e-dfaf-4a6d-b09b-812cdefe2ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0754936f-a7f3-4f4d-8e8b-ca07a6d7cbff tempest-AttachVolumeTestJSON-1630178730 None] Created volume successfully. Jul 09 16:43:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-51a5a71d-7868-4a6b-bad9-6ff8bf57a36a req-ca96c1d0-da17-4d42-bca1-a79bbdb272e3 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-51a5a71d-7868-4a6b-bad9-6ff8bf57a36a req-ca96c1d0-da17-4d42-bca1-a79bbdb272e3 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94c2c4b-9e87-4beb-8457-eb554971e871]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-51a5a71d-7868-4a6b-bad9-6ff8bf57a36a req-ca96c1d0-da17-4d42-bca1-a79bbdb272e3 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:24 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e Jul 09 16:43:24 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Flow 'volume_create_manager' (6d90d401-a7e4-4f21-9197-5e4f446c4bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c7aa84-2e71-49e4-b3d9-ec514c5bed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c7aa84-2e71-49e4-b3d9-ec514c5bed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-333698151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c8766a-bbc4-4cf7-9a40-92b59e4839af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d51a2d229bc4153849fea463de68a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:25Z,use_quota=True,user_id='c476f495e28c48e8b5a6e3eac6382003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64c6f0-b337-4148-baab-039b7387a278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe64c6f0-b337-4148-baab-039b7387a278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd7bb2d-775d-46cc-9e50-41509e14fe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd7bb2d-775d-46cc-9e50-41509e14fe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c8766a-bbc4-4cf7-9a40-92b59e4839af', 'volume_name': 'volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208027e4-bd42-4023-8b24-5e101a58a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208027e4-bd42-4023-8b24-5e101a58a52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ee252d-b730-4fc1-818d-30705418d4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Volume 22c8766a-bbc4-4cf7-9a40-92b59e4839af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af', 'volume_size': 1} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Flow 'volume_create_manager' (02180fc7-4bdc-4ec7-a5dd-e86d307dcb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df21608-a0bb-4bcd-8e86-f4d257ff9621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df21608-a0bb-4bcd-8e86-f4d257ff9621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-8393353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2708b50d-47a9-4db7-9339-13507cacfeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d51a2d229bc4153849fea463de68a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:26Z,use_quota=True,user_id='c476f495e28c48e8b5a6e3eac6382003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe93c795-9d28-4622-a220-fc68f9be1dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe93c795-9d28-4622-a220-fc68f9be1dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a89ae4-8347-4803-845f-39d46ff3ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a89ae4-8347-4803-845f-39d46ff3ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2708b50d-47a9-4db7-9339-13507cacfeaa', 'volume_name': 'volume-2708b50d-47a9-4db7-9339-13507cacfeaa', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928154ed-ace5-4deb-ac51-cf9e3af54e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928154ed-ace5-4deb-ac51-cf9e3af54e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e275b572-85b2-45fe-a0ed-fed6150b91c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Volume 2708b50d-47a9-4db7-9339-13507cacfeaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2708b50d-47a9-4db7-9339-13507cacfeaa', 'volume_size': 1} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:25 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-51a5a71d-7868-4a6b-bad9-6ff8bf57a36a req-ca96c1d0-da17-4d42-bca1-a79bbdb272e3 tempest-AttachVolumeTestJSON-1630178730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e" returned: 0 in 1.028s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-51a5a71d-7868-4a6b-bad9-6ff8bf57a36a req-ca96c1d0-da17-4d42-bca1-a79bbdb272e3 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-333698151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c8766a-bbc4-4cf7-9a40-92b59e4839af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d51a2d229bc4153849fea463de68a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:25Z,use_quota=True,user_id='c476f495e28c48e8b5a6e3eac6382003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Creating volume 22c8766a-bbc4-4cf7-9a40-92b59e4839af {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:43:25 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:25 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af 1073741824 Jul 09 16:43:25 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-51a5a71d-7868-4a6b-bad9-6ff8bf57a36a req-ca96c1d0-da17-4d42-bca1-a79bbdb272e3 tempest-AttachVolumeTestJSON-1630178730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa1831c5-4934-472f-9fb7-a97e44142e9e', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:43:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-51a5a71d-7868-4a6b-bad9-6ff8bf57a36a req-ca96c1d0-da17-4d42-bca1-a79bbdb272e3 tempest-AttachVolumeTestJSON-1630178730 None] attachment_update completed successfully. Jul 09 16:43:26 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af 1073741824" returned: 0 in 1.076s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:27 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af Jul 09 16:43:27 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:27 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af" returned: 0 in 0.691s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-8393353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2708b50d-47a9-4db7-9339-13507cacfeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d51a2d229bc4153849fea463de68a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:26Z,use_quota=True,user_id='c476f495e28c48e8b5a6e3eac6382003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Creating volume 2708b50d-47a9-4db7-9339-13507cacfeaa {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:43:27 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ee252d-b730-4fc1-818d-30705418d4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c94985-09be-4975-b05c-9ce6080017df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:27 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa 1073741824 Jul 09 16:43:27 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:27 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Volume volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af (22c8766a-bbc4-4cf7-9a40-92b59e4839af): created successfully Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c94985-09be-4975-b05c-9ce6080017df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Flow 'volume_create_manager' (6d90d401-a7e4-4f21-9197-5e4f446c4bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0fff80d5-09e7-40cc-ae10-44366fd802ba tempest-TestServerVolumeAttachmentScenario-607798860 None] Created volume successfully. Jul 09 16:43:28 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa 1073741824" returned: 0 in 0.930s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:28 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa Jul 09 16:43:28 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:28 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:43:28 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:29 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa" returned: 0 in 1.060s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e275b572-85b2-45fe-a0ed-fed6150b91c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2708b50d-47a9-4db7-9339-13507cacfeaa', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66d6c8e-8f60-460a-8657-17ef3fd486e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Volume volume-2708b50d-47a9-4db7-9339-13507cacfeaa (2708b50d-47a9-4db7-9339-13507cacfeaa): created successfully Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66d6c8e-8f60-460a-8657-17ef3fd486e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Flow 'volume_create_manager' (02180fc7-4bdc-4ec7-a5dd-e86d307dcb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0a395535-7568-4484-bcd7-fb8d3f98dcad tempest-TestServerVolumeAttachmentScenario-607798860 None] Created volume successfully. Jul 09 16:43:29 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.194s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:43:30 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:43:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:43:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:43:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-54185fb5-e7e0-442b-87d1-abd2a9a64b35 req-ff20fad8-1989-4ccd-b373-88a3ca868f33 tempest-AttachVolumeTestJSON-1630178730 None] Terminate volume connection completed successfully. Jul 09 16:43:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-54185fb5-e7e0-442b-87d1-abd2a9a64b35 req-ff20fad8-1989-4ccd-b373-88a3ca868f33 tempest-AttachVolumeTestJSON-1630178730 None] Deleting attachment c590c1ac-5447-4efe-9140-718ac61b7cb6. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:43:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-01eddb0d-2273-4465-8306-67f27c47be48 req-4af65523-8fda-480e-abdd-3b1e114de63e tempest-AttachVolumeTestJSON-1630178730 None] Terminate volume connection completed successfully. Jul 09 16:43:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-01eddb0d-2273-4465-8306-67f27c47be48 req-4af65523-8fda-480e-abdd-3b1e114de63e tempest-AttachVolumeTestJSON-1630178730 None] Deleting attachment aa1831c5-4934-472f-9fb7-a97e44142e9e. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:43:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=19,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:43:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:DELETE=6,cinder:UPDATE=57,cinder:SELECT=49,cinder:INSERT=14 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:43:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "cinder-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "cinder-quobyte-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-quobyte-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6c9742-efa6-4bcd-999b-e98898d136c3]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:46 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e Jul 09 16:43:46 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:47 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e" returned: 0 in 1.188s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:48 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e Jul 09 16:43:48 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:48 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e" returned: 0 in 0.795s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-quobyte-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e" released by "delete_volume" :: held 2.059s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Created reservations ['4db1977a-95b6-4701-a399-ae68c290345a', '065eb225-eac4-48d1-b045-b5313579f1e4', '2b00e820-4372-4fdc-a9d7-ad657f15e628', '303a6089-e3a9-404d-8c9b-9d2b157a4a6c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:48 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:43:48 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:49 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:43:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Deleted volume successfully. Jul 09 16:43:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7adcf73e-1a33-4a28-8c87-99c4fc47af95 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-1cc1e888-dc4e-4ed5-98f3-f7d73ea5b23e-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "cinder-af05cc19-ee3a-4af2-ada9-3f7698946324-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-af05cc19-ee3a-4af2-ada9-3f7698946324-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "cinder-quobyte-af05cc19-ee3a-4af2-ada9-3f7698946324" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-quobyte-af05cc19-ee3a-4af2-ada9-3f7698946324" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ecc9e6-a420-4d89-b74e-5c7ba6dba04b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:50 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 Jul 09 16:43:50 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:51 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:51 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324 Jul 09 16:43:51 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:51 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af05cc19-ee3a-4af2-ada9-3f7698946324" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-quobyte-af05cc19-ee3a-4af2-ada9-3f7698946324" released by "delete_volume" :: held 1.641s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Created reservations ['ad7b57e5-086f-48f4-972a-184017856b0b', 'a21f769c-f1e5-4b0e-8a18-e7494996f4a6', 'a5fec3a3-8718-457f-b086-1450dde324e5', '51fbbf7a-9b94-4d27-9d27-68f73419e005'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:52 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:43:52 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "cinder-cb87461d-17f9-422e-a5c2-b0707ae797cd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-cb87461d-17f9-422e-a5c2-b0707ae797cd-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "cinder-quobyte-cb87461d-17f9-422e-a5c2-b0707ae797cd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-quobyte-cb87461d-17f9-422e-a5c2-b0707ae797cd" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[526335ea-7b22-40a3-82a0-46a8ef53c3e0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:43:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:53 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.944s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:53 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:43:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Deleted volume successfully. Jul 09 16:43:53 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd Jul 09 16:43:53 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d219b860-f3bd-4208-a8d0-cfea1a2a979d tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-af05cc19-ee3a-4af2-ada9-3f7698946324-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:53 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:53 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd Jul 09 16:43:53 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:54 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cb87461d-17f9-422e-a5c2-b0707ae797cd" returned: 0 in 0.788s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-quobyte-cb87461d-17f9-422e-a5c2-b0707ae797cd" released by "delete_volume" :: held 1.882s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Created reservations ['cba7bf39-a18c-4300-af22-2226942c0ab2', '9e74ae7b-09d1-41dd-8362-7ec3c355ae4c', '1cacabcb-7fa8-455b-895e-85de911afde2', 'd81f3d7a-d53c-4b64-941b-64a3f055eb4b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:54 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:43:54 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:55 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.921s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:43:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Deleted volume successfully. Jul 09 16:43:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ebfd55d7-e1a9-45ba-9b69-bc4ae692d719 tempest-AttachVolumeTestJSON-1630178730 None] Lock "cinder-cb87461d-17f9-422e-a5c2-b0707ae797cd-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Flow 'volume_create_manager' (e259ca16-822f-4ccd-91e3-cbb539e5ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3421fbc-c8da-4505-88f4-8df145d40b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3421fbc-c8da-4505-88f4-8df145d40b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-915846566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe131ad-5275-4b43-9b04-a57efb347332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8640e4001f41c18b6819d32df4e89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:56Z,use_quota=True,user_id='fcf9d36619794c8daf9340a694e9aab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6eca10-bf21-461a-ae63-916be7a2615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6eca10-bf21-461a-ae63-916be7a2615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61c184f-1d1a-4800-bcd9-a5511ad08ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61c184f-1d1a-4800-bcd9-a5511ad08ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe131ad-5275-4b43-9b04-a57efb347332', 'volume_name': 'volume-5fe131ad-5275-4b43-9b04-a57efb347332', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ed0bbc-04aa-452a-8b9b-089331abaebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ed0bbc-04aa-452a-8b9b-089331abaebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f400ac-851e-4239-b792-15785b1f3c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Volume 5fe131ad-5275-4b43-9b04-a57efb347332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe131ad-5275-4b43-9b04-a57efb347332', 'volume_size': 1} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-915846566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe131ad-5275-4b43-9b04-a57efb347332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8640e4001f41c18b6819d32df4e89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:43:56Z,use_quota=True,user_id='fcf9d36619794c8daf9340a694e9aab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Creating volume 5fe131ad-5275-4b43-9b04-a57efb347332 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:43:56 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:43:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:56 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 1073741824 Jul 09 16:43:56 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:57 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 1073741824" returned: 0 in 0.934s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:43:57 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 Jul 09 16:43:57 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:43:58 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 09 16:43:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:43:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f400ac-851e-4239-b792-15785b1f3c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe131ad-5275-4b43-9b04-a57efb347332', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd0443c-8709-47c7-a7b2-6be3d7eb52b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:43:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Volume volume-5fe131ad-5275-4b43-9b04-a57efb347332 (5fe131ad-5275-4b43-9b04-a57efb347332): created successfully Jul 09 16:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd0443c-8709-47c7-a7b2-6be3d7eb52b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:43:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Flow 'volume_create_manager' (e259ca16-822f-4ccd-91e3-cbb539e5ca69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:43:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-49e18b8d-0f1e-4bdc-9a0c-57cffdc4c3f7 tempest-TestMinimumBasicScenario-616665809 None] Created volume successfully. Jul 09 16:44:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-f92c5f6e-1194-4bcc-ab84-ecdad4474200 req-60e6eebf-3f3a-4e6e-ad98-f28fb2f431d6 tempest-TestMinimumBasicScenario-616665809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-f92c5f6e-1194-4bcc-ab84-ecdad4474200 req-60e6eebf-3f3a-4e6e-ad98-f28fb2f431d6 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[412058b4-21d5-4e35-804a-5d2dcd11e973]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-f92c5f6e-1194-4bcc-ab84-ecdad4474200 req-60e6eebf-3f3a-4e6e-ad98-f28fb2f431d6 tempest-TestMinimumBasicScenario-616665809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:02 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 Jul 09 16:44:02 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9d468ac8-fae8-48f3-aa2c-7ad86c04ac7e tempest-GroupSnapshotsTest-1237295949 None] Group tempest-GroupSnapshotsTest-Group-271510229: creating Jul 09 16:44:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9d468ac8-fae8-48f3-aa2c-7ad86c04ac7e tempest-GroupSnapshotsTest-1237295949 None] Group tempest-GroupSnapshotsTest-Group-271510229: created successfully Jul 09 16:44:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9d468ac8-fae8-48f3-aa2c-7ad86c04ac7e tempest-GroupSnapshotsTest-1237295949 None] Create group completed successfully. Jul 09 16:44:02 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-f92c5f6e-1194-4bcc-ab84-ecdad4474200 req-60e6eebf-3f3a-4e6e-ad98-f28fb2f431d6 tempest-TestMinimumBasicScenario-616665809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332" returned: 0 in 0.806s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-f92c5f6e-1194-4bcc-ab84-ecdad4474200 req-60e6eebf-3f3a-4e6e-ad98-f28fb2f431d6 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-f92c5f6e-1194-4bcc-ab84-ecdad4474200 req-60e6eebf-3f3a-4e6e-ad98-f28fb2f431d6 tempest-TestMinimumBasicScenario-616665809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-5fe131ad-5275-4b43-9b04-a57efb347332', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c67d4823-5158-48dc-b2ba-48722a287496', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:44:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-f92c5f6e-1194-4bcc-ab84-ecdad4474200 req-60e6eebf-3f3a-4e6e-ad98-f28fb2f431d6 tempest-TestMinimumBasicScenario-616665809 None] attachment_update completed successfully. Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (747f8dc5-5412-4700-bbbb-63bd431e8ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbfaaff-711e-4c36-afdf-bac767f5b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbfaaff-711e-4c36-afdf-bac767f5b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24577083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25e7fcac-8dd4-484d-a3c2-d50f379cb5f1,host='devstack@QuobyteHD#QuobyteHD',id=1102fd96-1bc5-4933-99b4-e5fc33869d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:44:04Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71e3ec4c-e76b-4690-824b-ac4d4384abde),volume_type_id=71e3ec4c-e76b-4690-824b-ac4d4384abde)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2852e7-2cbe-42d6-9dbd-27cebf76637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2852e7-2cbe-42d6-9dbd-27cebf76637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ac5626-115d-4e7e-a462-5d21f07ab5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ac5626-115d-4e7e-a462-5d21f07ab5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1102fd96-1bc5-4933-99b4-e5fc33869d94', 'volume_name': 'volume-1102fd96-1bc5-4933-99b4-e5fc33869d94', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3a7b62-c0b1-4e5b-896c-f5f701e894cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3a7b62-c0b1-4e5b-896c-f5f701e894cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b433c6-8ac1-4f2b-a385-cc7452749935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Volume 1102fd96-1bc5-4933-99b4-e5fc33869d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1102fd96-1bc5-4933-99b4-e5fc33869d94', 'volume_size': 1} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25e7fcac-8dd4-484d-a3c2-d50f379cb5f1,created_at=2026-07-09T14:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24577083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25e7fcac-8dd4-484d-a3c2-d50f379cb5f1,host='devstack@QuobyteHD#QuobyteHD',id=1102fd96-1bc5-4933-99b4-e5fc33869d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:44:04Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71e3ec4c-e76b-4690-824b-ac4d4384abde),volume_type_id=71e3ec4c-e76b-4690-824b-ac4d4384abde)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Creating volume 1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:44:04 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:44:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:04 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 1073741824 Jul 09 16:44:04 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:05 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 1073741824" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:05 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 Jul 09 16:44:05 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:06 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94" returned: 0 in 0.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:44:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b433c6-8ac1-4f2b-a385-cc7452749935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1102fd96-1bc5-4933-99b4-e5fc33869d94', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51d3137-cb95-4998-bddf-47b925341567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Volume volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 (1102fd96-1bc5-4933-99b4-e5fc33869d94): created successfully Jul 09 16:44:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51d3137-cb95-4998-bddf-47b925341567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (747f8dc5-5412-4700-bbbb-63bd431e8ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:44:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f2193919-a0ce-4274-842b-24ab0583b641 tempest-GroupSnapshotsTest-1237295949 None] Created volume successfully. Jul 09 16:44:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] GroupSnapshot c6e5834a-912f-4a16-a753-6aef576625f6: creating. Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Group snapshot c6e5834a-912f-4a16-a753-6aef576625f6: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Creating offline snapshot 99f11bd6-69db-4760-8495-6631ae6f92f4 of volume 1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e882bee-2267-43fa-9af0-598e993f8995]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:07 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 Jul 09 16:44:07 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:07 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94" returned: 0 in 0.847s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:07 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 1G Jul 09 16:44:07 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:08 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 1G" returned: 0 in 0.839s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:08 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 Jul 09 16:44:08 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:09 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:09 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:44:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:09 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 Jul 09 16:44:09 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:10 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4" returned: 0 in 0.669s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:10 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.info Jul 09 16:44:10 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:11 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.info" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:11 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:11 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.info Jul 09 16:44:11 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-96aa8a27-76dc-4960-b43a-05aff436b426 req-a69f2b01-ba20-4d08-92c0-0b30ae7c5ca9 tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:11 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.info" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.717s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-96aa8a27-76dc-4960-b43a-05aff436b426 req-a69f2b01-ba20-4d08-92c0-0b30ae7c5ca9 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.550s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb3988-7c46-4513-9d2c-3c9cee932379]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-96aa8a27-76dc-4960-b43a-05aff436b426 req-a69f2b01-ba20-4d08-92c0-0b30ae7c5ca9 tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9b410bb4-ddbf-45b8-97a8-b0ed20f33e44 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot c6e5834a-912f-4a16-a753-6aef576625f6: created successfully Jul 09 16:44:11 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af Jul 09 16:44:11 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:12 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-96aa8a27-76dc-4960-b43a-05aff436b426 req-a69f2b01-ba20-4d08-92c0-0b30ae7c5ca9 tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af" returned: 0 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-96aa8a27-76dc-4960-b43a-05aff436b426 req-a69f2b01-ba20-4d08-92c0-0b30ae7c5ca9 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-96aa8a27-76dc-4960-b43a-05aff436b426 req-a69f2b01-ba20-4d08-92c0-0b30ae7c5ca9 tempest-TestServerVolumeAttachmentScenario-607798860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0142dcec-57a2-4936-bb75-ec7f03b7c582', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:44:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-96aa8a27-76dc-4960-b43a-05aff436b426 req-a69f2b01-ba20-4d08-92c0-0b30ae7c5ca9 tempest-TestServerVolumeAttachmentScenario-607798860 None] attachment_update completed successfully. Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-99f11bd6-69db-4760-8495-6631ae6f92f4-f090c1dc-eeb6-4330-9417-5714a8737671" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-99f11bd6-69db-4760-8495-6631ae6f92f4-f090c1dc-eeb6-4330-9417-5714a8737671" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Creating volume f090c1dc-eeb6-4330-9417-5714a8737671 from snapshot 99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-f090c1dc-eeb6-4330-9417-5714a8737671" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-f090c1dc-eeb6-4330-9417-5714a8737671" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] snapshot: 99f11bd6-69db-4760-8495-6631ae6f92f4, volume: f090c1dc-eeb6-4330-9417-5714a8737671, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7213553-ca2e-47f4-bbf3-9edc3c2cd649]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:13 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 Jul 09 16:44:13 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:14 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4" returned: 0 in 0.871s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1102fd96-1bc5-4933-99b4-e5fc33869d94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:44:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:44:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:44:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe381d2-9dd2-4242-a0a4-b10fdfc783e4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:14 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 Jul 09 16:44:14 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:15 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:15 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:44:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:15 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 Jul 09 16:44:15 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:21 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671" returned: 0 in 5.671s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc89f11-bd31-4afc-bee4-811e1364241f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:21 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 Jul 09 16:44:21 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:22 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:22 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:44:22 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Converted 1024.00 MB image at 180.50 MB/s Jul 09 16:44:22 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:22 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 Jul 09 16:44:22 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:22 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671" returned: 0 in 0.665s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-f090c1dc-eeb6-4330-9417-5714a8737671" released by "_copy_volume_from_snapshot" :: held 9.068s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-99f11bd6-69db-4760-8495-6631ae6f92f4-f090c1dc-eeb6-4330-9417-5714a8737671" released by "_create_volume_from_snapshot" :: held 9.118s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.135s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-56459e2a-efba-4198-8612-634f1168695a tempest-GroupSnapshotsTest-1237295949 None] Create group from source-snapshot-c6e5834a-912f-4a16-a753-6aef576625f6 completed successfully. Jul 09 16:44:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-f090c1dc-eeb6-4330-9417-5714a8737671" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-f090c1dc-eeb6-4330-9417-5714a8737671" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda752c8-8727-4e84-9eef-a81fb6940956]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:24 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 Jul 09 16:44:24 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:24 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:24 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671 Jul 09 16:44:24 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-66fa4952-d119-4778-938b-8fbcf6968be6 req-9c872230-6dd3-4c4f-ba8b-dd072bca6bac tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-66fa4952-d119-4778-938b-8fbcf6968be6 req-9c872230-6dd3-4c4f-ba8b-dd072bca6bac tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a7fa0-94e3-4a5d-9b2f-14285b1cbefa]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-66fa4952-d119-4778-938b-8fbcf6968be6 req-9c872230-6dd3-4c4f-ba8b-dd072bca6bac tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:24 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa Jul 09 16:44:24 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:25 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f090c1dc-eeb6-4330-9417-5714a8737671" returned: 0 in 0.737s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-f090c1dc-eeb6-4330-9417-5714a8737671" released by "delete_volume" :: held 1.639s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['508031ff-fcd7-446b-a24a-2f0f5941fc5c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:25 devstack cinder-volume[87204]: WARNING cinder.quota [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-249940549 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-249940549, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:44:25 devstack cinder-volume[87204]: WARNING cinder.quota [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-249940549 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-249940549, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['16b57d41-2779-48fb-8bea-c733ad83983a', '7e82fbcd-1f2e-4bcb-9909-e448575d2591', 'b60d0e67-6e5b-4629-b04a-739457a7b292', '50d3730f-56da-4c43-b30c-e1146afda4a6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:25 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-66fa4952-d119-4778-938b-8fbcf6968be6 req-9c872230-6dd3-4c4f-ba8b-dd072bca6bac tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa" returned: 0 in 0.829s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-66fa4952-d119-4778-938b-8fbcf6968be6 req-9c872230-6dd3-4c4f-ba8b-dd072bca6bac tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-66fa4952-d119-4778-938b-8fbcf6968be6 req-9c872230-6dd3-4c4f-ba8b-dd072bca6bac tempest-TestServerVolumeAttachmentScenario-607798860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-2708b50d-47a9-4db7-9339-13507cacfeaa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6d9b9e3-6cc2-4031-9425-6a197d7f6b2b', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:25 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:44:25 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-66fa4952-d119-4778-938b-8fbcf6968be6 req-9c872230-6dd3-4c4f-ba8b-dd072bca6bac tempest-TestServerVolumeAttachmentScenario-607798860 None] attachment_update completed successfully. Jul 09 16:44:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot c6e5834a-912f-4a16-a753-6aef576625f6: deleting Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot c6e5834a-912f-4a16-a753-6aef576625f6: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-1102fd96-1bc5-4933-99b4-e5fc33869d94" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-1102fd96-1bc5-4933-99b4-e5fc33869d94" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-99f11bd6-69db-4760-8495-6631ae6f92f4" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:26 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-99f11bd6-69db-4760-8495-6631ae6f92f4" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Deleting offline snapshot 99f11bd6-69db-4760-8495-6631ae6f92f4 of volume 1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] snapshot_file for this snap is: volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:44:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5c67e902-6cdc-49f7-8d69-48e0629d7c00 tempest-GroupSnapshotsTest-1237295949 None] Delete group completed successfully. Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d4e2e6-1a6e-4f48-91ed-05e7bcc07f14]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:26 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 Jul 09 16:44:26 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:27 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4" returned: 0 in 0.861s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1102fd96-1bc5-4933-99b4-e5fc33869d94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:44:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[510241f0-4c3c-4bbb-9ec0-0e87d37c6130]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:27 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 Jul 09 16:44:27 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:28 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94" returned: 0 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:28 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 Jul 09 16:44:28 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:28 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:44:28 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:28 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:28 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4 Jul 09 16:44:28 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:29 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.726s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:44:29 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94.99f11bd6-69db-4760-8495-6631ae6f92f4" returned: 0 in 0.645s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-99f11bd6-69db-4760-8495-6631ae6f92f4" released by "_delete_snapshot" :: held 3.119s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-1102fd96-1bc5-4933-99b4-e5fc33869d94" released by "delete_snapshot" :: held 3.166s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:29 devstack cinder-volume[87204]: WARNING cinder.quota [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-249940549 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-249940549, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:44:29 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['419cf528-9eaf-4242-b050-eac9bedb8aed', 'bfc16a7a-0786-4e2b-a96e-373101ec5c4a', '2be89a81-ab6f-4a30-96c9-ad702738d9d5', '48d4b191-0ac7-45ca-a8fe-661bde043ee2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c5c9b7f8-97df-4ad5-a7b4-d2a25aa846c0 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot c6e5834a-912f-4a16-a753-6aef576625f6: deleted successfully Jul 09 16:44:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-1102fd96-1bc5-4933-99b4-e5fc33869d94" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-1102fd96-1bc5-4933-99b4-e5fc33869d94" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3334fcf3-6197-4177-b883-575e9540cac0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:31 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 Jul 09 16:44:31 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:32 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94" returned: 0 in 0.839s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:32 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94 Jul 09 16:44:32 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-2abe73c5-2d4b-4a38-9155-0ac982c7b675 req-2eb9e57e-4d3f-44f8-9a72-1d2a94d64fe2 tempest-TestServerVolumeAttachmentScenario-607798860 None] Terminate volume connection completed successfully. Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-2abe73c5-2d4b-4a38-9155-0ac982c7b675 req-2eb9e57e-4d3f-44f8-9a72-1d2a94d64fe2 tempest-TestServerVolumeAttachmentScenario-607798860 None] Deleting attachment b6d9b9e3-6cc2-4031-9425-6a197d7f6b2b. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:44:32 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1102fd96-1bc5-4933-99b4-e5fc33869d94" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-1102fd96-1bc5-4933-99b4-e5fc33869d94" released by "delete_volume" :: held 1.643s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['9f4e51bb-5334-4e76-857a-d8314fe2ea4b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:32 devstack cinder-volume[87204]: WARNING cinder.db.api [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-249940549'] Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['d08700c5-6526-487f-be15-a19befef506d', 'ad436e1a-758c-486e-a59d-822e7919951f', 'd333ab6d-0d4c-484f-a344-385fee334bfc', '982a61e7-0dc9-4516-a142-67d1aa5a49d0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:33 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:44:33 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:33 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:33 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:44:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d382e6db-83a0-4e17-bd0b-31be53a4aba6 tempest-GroupSnapshotsTest-1237295949 None] Delete group completed successfully. Jul 09 16:44:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-73a2cd3c-e35e-43d0-bb4e-59eccc481aec tempest-GroupSnapshotsTest-1237295949 None] Group tempest-GroupSnapshotsTest-Group-106258788: creating Jul 09 16:44:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-73a2cd3c-e35e-43d0-bb4e-59eccc481aec tempest-GroupSnapshotsTest-1237295949 None] Group tempest-GroupSnapshotsTest-Group-106258788: created successfully Jul 09 16:44:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-73a2cd3c-e35e-43d0-bb4e-59eccc481aec tempest-GroupSnapshotsTest-1237295949 None] Create group completed successfully. Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (6bbefbc6-1318-4b45-910e-6c6c8e9392f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee09805-0208-472c-b619-f8c84fdc9056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee09805-0208-472c-b619-f8c84fdc9056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-633827764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afdd6c68-4076-4b26-b34b-53699c5de252,host='devstack@QuobyteHD#QuobyteHD',id=c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:44:36Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4),volume_type_id=8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac3173c-761f-42c8-ae0d-5e840ad56be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac3173c-761f-42c8-ae0d-5e840ad56be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21d3d12-8313-4cec-9483-e5bfef269573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21d3d12-8313-4cec-9483-e5bfef269573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc', 'volume_name': 'volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b89bd9-7ed1-4e82-b92a-0850a0387b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b89bd9-7ed1-4e82-b92a-0850a0387b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5eae4f-4825-4fa7-a55c-03d2fa2c5f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Volume c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc', 'volume_size': 1} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=afdd6c68-4076-4b26-b34b-53699c5de252,created_at=2026-07-09T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-633827764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afdd6c68-4076-4b26-b34b-53699c5de252,host='devstack@QuobyteHD#QuobyteHD',id=c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:44:36Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4),volume_type_id=8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Creating volume c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:44:35 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:44:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:35 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc 1073741824 Jul 09 16:44:35 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-c2296ef6-a933-4aac-ab4e-08ab1c5e46e3 req-1731b8b2-08ee-486b-931a-7d57d5601e1b tempest-TestServerVolumeAttachmentScenario-607798860 None] Terminate volume connection completed successfully. Jul 09 16:44:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-c2296ef6-a933-4aac-ab4e-08ab1c5e46e3 req-1731b8b2-08ee-486b-931a-7d57d5601e1b tempest-TestServerVolumeAttachmentScenario-607798860 None] Deleting attachment 0142dcec-57a2-4936-bb75-ec7f03b7c582. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:44:36 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc 1073741824" returned: 0 in 0.874s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:36 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc Jul 09 16:44:36 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:37 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:44:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5eae4f-4825-4fa7-a55c-03d2fa2c5f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a9cc16-bf2a-4432-b1ef-0fe28272911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:37 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Volume volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc (c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc): created successfully Jul 09 16:44:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a9cc16-bf2a-4432-b1ef-0fe28272911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (6bbefbc6-1318-4b45-910e-6c6c8e9392f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:44:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6658243a-5144-42ac-95d8-3dff931197b6 tempest-GroupSnapshotsTest-1237295949 None] Created volume successfully. Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (e546d443-f170-4fbf-9f3d-8b41a87f2cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2959e18f-80bc-4d30-a992-f26edfb2d402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2959e18f-80bc-4d30-a992-f26edfb2d402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-568251947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afdd6c68-4076-4b26-b34b-53699c5de252,host='devstack@QuobyteHD#QuobyteHD',id=58208fe6-8c56-47ae-9f2b-daa1d2a4043b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:44:39Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4),volume_type_id=8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263f73f1-1926-4d56-b6fd-92f9b2dd83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263f73f1-1926-4d56-b6fd-92f9b2dd83ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37de1863-5f8a-4e25-877d-3b1a379656d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37de1863-5f8a-4e25-877d-3b1a379656d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58208fe6-8c56-47ae-9f2b-daa1d2a4043b', 'volume_name': 'volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417348d9-fea5-41f6-b970-49eff4fe1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417348d9-fea5-41f6-b970-49eff4fe1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4a714f-a3f2-4c53-94d8-b5ccbfa93a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Volume 58208fe6-8c56-47ae-9f2b-daa1d2a4043b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b', 'volume_size': 1} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=afdd6c68-4076-4b26-b34b-53699c5de252,created_at=2026-07-09T14:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-568251947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afdd6c68-4076-4b26-b34b-53699c5de252,host='devstack@QuobyteHD#QuobyteHD',id=58208fe6-8c56-47ae-9f2b-daa1d2a4043b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:44:39Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4),volume_type_id=8ff7a818-4cb5-4955-ba1e-a0e8bedc21f4)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Creating volume 58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:44:38 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:44:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:38 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b 1073741824 Jul 09 16:44:38 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:39 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b 1073741824" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:39 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b Jul 09 16:44:39 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:40 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" returned: 0 in 0.669s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:44:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4a714f-a3f2-4c53-94d8-b5ccbfa93a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8060e360-cb2d-4621-816d-5b7ba83161ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:44:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Volume volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b (58208fe6-8c56-47ae-9f2b-daa1d2a4043b): created successfully Jul 09 16:44:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8060e360-cb2d-4621-816d-5b7ba83161ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:44:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (e546d443-f170-4fbf-9f3d-8b41a87f2cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:44:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-28c62704-9384-4dcb-b588-8e239f166490 tempest-GroupSnapshotsTest-1237295949 None] Created volume successfully. Jul 09 16:44:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ee64a124-5957-433a-b45c-591c36110a10 tempest-GroupSnapshotsTest-1237295949 None] Update group completed successfully. Jul 09 16:44:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2e216966-1557-48d1-93fd-c974aaac1ef6 tempest-GroupSnapshotsTest-1237295949 None] Update group completed successfully. Jul 09 16:44:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3f69159c-f56b-454b-a3a6-4c8fa75d3bf7 tempest-GroupSnapshotsTest-1237295949 None] Update group completed successfully. Jul 09 16:44:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=91,cinder:UPDATE=74,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:44:44 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=80,cinder:INSERT=21,cinder:UPDATE=78,cinder:DELETE=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:44:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3f92e063-85c4-439a-a328-9452ce194122 tempest-GroupSnapshotsTest-1237295949 None] Update group completed successfully. Jul 09 16:44:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] GroupSnapshot fae49d17-f875-4e1a-8d19-97e5c825d8fb: creating. Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Group snapshot fae49d17-f875-4e1a-8d19-97e5c825d8fb: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Creating offline snapshot 1e99cad7-74a3-442d-8302-eda09eca81d0 of volume c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd31dd-d20b-4021-aa51-431516ad3ce7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:46 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc Jul 09 16:44:46 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "cinder-2708b50d-47a9-4db7-9339-13507cacfeaa-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-2708b50d-47a9-4db7-9339-13507cacfeaa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "cinder-quobyte-2708b50d-47a9-4db7-9339-13507cacfeaa" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-quobyte-2708b50d-47a9-4db7-9339-13507cacfeaa" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6a1729-d02b-40ef-8602-2a4a5ef5a20f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:47 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa Jul 09 16:44:47 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:47 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:47 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 1G Jul 09 16:44:47 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:47 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:47 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa Jul 09 16:44:47 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:48 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 1G" returned: 0 in 0.970s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:48 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 Jul 09 16:44:48 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:48 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2708b50d-47a9-4db7-9339-13507cacfeaa" returned: 0 in 0.778s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-quobyte-2708b50d-47a9-4db7-9339-13507cacfeaa" released by "delete_volume" :: held 1.677s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Created reservations ['e815ec9d-dfd8-4d2e-ac4f-e9a269a1c9df', '2c4f2a76-873b-45b7-912a-82d34df0b0f0', '5f8454e8-a615-4972-b391-daa5c8a46450', '331c2a3a-ddf6-4d2d-9b8b-04b87604cd6e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:48 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:44:48 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:49 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0" returned: 0 in 0.909s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:49 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:49 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 Jul 09 16:44:49 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "cinder-22c8766a-bbc4-4cf7-9a40-92b59e4839af-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-22c8766a-bbc4-4cf7-9a40-92b59e4839af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "cinder-quobyte-22c8766a-bbc4-4cf7-9a40-92b59e4839af" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-quobyte-22c8766a-bbc4-4cf7-9a40-92b59e4839af" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59fa9e-dc41-4846-9084-bb88c31bd396]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:49 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af Jul 09 16:44:49 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:49 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:44:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Deleted volume successfully. Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dc5281df-3bb7-452f-8692-1cc187d6a7e5 tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-2708b50d-47a9-4db7-9339-13507cacfeaa-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:49 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:50 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.info Jul 09 16:44:50 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:50 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af" returned: 0 in 0.909s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:50 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af Jul 09 16:44:50 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:50 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.info" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:50 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:44:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:50 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.info Jul 09 16:44:50 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-e20f1d3f-8d93-4fde-9030-bf30544301c7 req-a5383bf6-3eea-47e5-9e0f-785a76d4f837 tempest-TestMinimumBasicScenario-616665809 None] Terminate volume connection completed successfully. Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-e20f1d3f-8d93-4fde-9030-bf30544301c7 req-a5383bf6-3eea-47e5-9e0f-785a76d4f837 tempest-TestMinimumBasicScenario-616665809 None] Deleting attachment c67d4823-5158-48dc-b2ba-48722a287496. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:44:51 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22c8766a-bbc4-4cf7-9a40-92b59e4839af" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-quobyte-22c8766a-bbc4-4cf7-9a40-92b59e4839af" released by "delete_volume" :: held 1.708s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Created reservations ['c5cad4ee-1680-4e59-8def-f20a63fcdda5', '83287992-2967-451b-bd4d-2a59f4146c5b', 'ddcc422c-323d-4743-a2e7-6d3db63adf7c', '31012749-6946-4c11-91b6-12933b3bf8e0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:51 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:44:51 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:51 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.info" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.158s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Creating offline snapshot 77e888a9-a62a-432b-897a-cf26fd7ba5bd of volume 58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba6f7f7-c049-4b3a-886e-785ca3e1688a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:51 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b Jul 09 16:44:51 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:52 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:52 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:44:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Deleted volume successfully. Jul 09 16:44:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9a3ec5f0-c377-4936-8b27-6ce52d6f9fce tempest-TestServerVolumeAttachmentScenario-607798860 None] Lock "cinder-22c8766a-bbc4-4cf7-9a40-92b59e4839af-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:52 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:52 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd 1G Jul 09 16:44:52 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Acquiring lock "cinder-5fe131ad-5275-4b43-9b04-a57efb347332-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Lock "cinder-5fe131ad-5275-4b43-9b04-a57efb347332-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Acquiring lock "cinder-quobyte-5fe131ad-5275-4b43-9b04-a57efb347332" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Lock "cinder-quobyte-5fe131ad-5275-4b43-9b04-a57efb347332" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa410a-c018-4fef-ad7b-ae068ac21a4b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:53 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 Jul 09 16:44:53 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:53 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd 1G" returned: 0 in 0.906s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:53 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd Jul 09 16:44:53 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:54 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:54 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332 Jul 09 16:44:54 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:54 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:54 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:54 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd Jul 09 16:44:54 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:54 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5fe131ad-5275-4b43-9b04-a57efb347332" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Lock "cinder-quobyte-5fe131ad-5275-4b43-9b04-a57efb347332" released by "delete_volume" :: held 1.673s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:54 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd" returned: 0 in 0.806s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Created reservations ['77b0d916-084d-4215-8e8f-ee710a280b25', '5e2e98ee-182b-4085-a7ee-959b084a079c', '0c6a28b5-b647-4b6e-84d3-bd602f105bb2', 'ad704929-11f3-4c79-b7b0-4cbeeef10a92'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:44:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:55 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.info Jul 09 16:44:55 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:55 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:44:55 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:55 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.info" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:55 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:55 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.758s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:44:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Deleted volume successfully. Jul 09 16:44:55 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.info Jul 09 16:44:55 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-806707b4-25d0-4397-a367-7daf139d4ab6 tempest-TestMinimumBasicScenario-616665809 None] Lock "cinder-5fe131ad-5275-4b43-9b04-a57efb347332-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:44:56 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.info" returned: 0 in 0.717s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.986s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:44:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-419ea9ac-9a56-42e4-9583-335da9657a2a tempest-GroupSnapshotsTest-1237295949 None] group_snapshot fae49d17-f875-4e1a-8d19-97e5c825d8fb: created successfully Jul 09 16:44:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot fae49d17-f875-4e1a-8d19-97e5c825d8fb: deleting Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot fae49d17-f875-4e1a-8d19-97e5c825d8fb: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-1e99cad7-74a3-442d-8302-eda09eca81d0" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-1e99cad7-74a3-442d-8302-eda09eca81d0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Deleting offline snapshot 1e99cad7-74a3-442d-8302-eda09eca81d0 of volume c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] snapshot_file for this snap is: volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94e048-3f58-4819-a25f-4907b976f106]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:57 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 Jul 09 16:44:57 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:58 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0" returned: 0 in 0.922s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:44:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d58d6c-f4b2-4ff5-9f48-61ed29391740]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:44:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:58 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc Jul 09 16:44:58 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:59 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" returned: 0 in 0.904s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:59 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 Jul 09 16:44:59 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:44:59 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 09 16:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:44:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:44:59 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0 Jul 09 16:44:59 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:00 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc.1e99cad7-74a3-442d-8302-eda09eca81d0" returned: 0 in 0.675s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-1e99cad7-74a3-442d-8302-eda09eca81d0" released by "_delete_snapshot" :: held 3.463s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" released by "delete_snapshot" :: held 3.493s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-77e888a9-a62a-432b-897a-cf26fd7ba5bd" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-77e888a9-a62a-432b-897a-cf26fd7ba5bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Deleting offline snapshot 77e888a9-a62a-432b-897a-cf26fd7ba5bd of volume 58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] snapshot_file for this snap is: volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08fd7f8-e1d8-4aa8-8acb-821337ad29d9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:00 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd Jul 09 16:45:00 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:01 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd" returned: 0 in 0.847s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:45:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7bd777-0bfb-47e4-9436-2c59027fabb2]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:01 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b Jul 09 16:45:01 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:02 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" returned: 0 in 0.901s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:02 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd Jul 09 16:45:02 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (f50b5cb4-bcaf-4927-a13f-f954477428a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc043fce-0383-4097-ab58-9990a9dd69ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc043fce-0383-4097-ab58-9990a9dd69ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2031022416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:03Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51dbc46-7784-4c45-a32e-621125866d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51dbc46-7784-4c45-a32e-621125866d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2216ae-b88c-4638-a0fb-5d7027bb5211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2216ae-b88c-4638-a0fb-5d7027bb5211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61', 'volume_name': 'volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb2f20e-edcb-46e6-98ea-9d0f283d7df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb2f20e-edcb-46e6-98ea-9d0f283d7df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edd6c0a-207c-42a5-8ffe-50c499c29c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Volume 38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61', 'volume_size': 1} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2031022416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:03Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Creating volume 38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:03 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:03 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 1073741824 Jul 09 16:45:03 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:03 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd" returned: 0 in 0.993s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:03 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd Jul 09 16:45:03 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (42eed165-eaaf-4e8e-bdee-929a6abf4e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fed4b1-8ed8-45b3-9dfc-773740ab7485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fed4b1-8ed8-45b3-9dfc-773740ab7485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428176704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b6a24c-30c5-4353-9eb0-8629d139e81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:03Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaf5295-deac-4962-941d-d9e7d2e2db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aaf5295-deac-4962-941d-d9e7d2e2db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8aa27e-4c7e-43af-b7af-2f680f3179cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8aa27e-4c7e-43af-b7af-2f680f3179cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b6a24c-30c5-4353-9eb0-8629d139e81e', 'volume_name': 'volume-28b6a24c-30c5-4353-9eb0-8629d139e81e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80555922-c331-4ee3-aa66-a606288d0b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80555922-c331-4ee3-aa66-a606288d0b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10869b2-9490-4c62-a07f-eb9b5ee10bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Volume 28b6a24c-30c5-4353-9eb0-8629d139e81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b6a24c-30c5-4353-9eb0-8629d139e81e', 'volume_size': 1} Jul 09 16:45:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (0cda22f8-fd87-433b-b8a3-314fbd0d3de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7012cfb9-d883-4461-abd6-71d30d8382e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7012cfb9-d883-4461-abd6-71d30d8382e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-162009374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aba17c-497c-456d-b93c-c90a42c085bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:04Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba588268-5e88-4dc7-a676-79e3e1e3ddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba588268-5e88-4dc7-a676-79e3e1e3ddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc7f1a2-ed59-4ee1-8721-0ff9dede9d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc7f1a2-ed59-4ee1-8721-0ff9dede9d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9aba17c-497c-456d-b93c-c90a42c085bb', 'volume_name': 'volume-a9aba17c-497c-456d-b93c-c90a42c085bb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9223d14-50c9-45e0-bb60-261a183c4ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9223d14-50c9-45e0-bb60-261a183c4ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58b1c84-b4fe-420f-a023-4066ebf7a900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Volume a9aba17c-497c-456d-b93c-c90a42c085bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9aba17c-497c-456d-b93c-c90a42c085bb', 'volume_size': 1} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b.77e888a9-a62a-432b-897a-cf26fd7ba5bd" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-77e888a9-a62a-432b-897a-cf26fd7ba5bd" released by "_delete_snapshot" :: held 3.773s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" released by "delete_snapshot" :: held 3.802s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:04 devstack cinder-volume[87204]: WARNING cinder.quota [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1248704808 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1248704808, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:04 devstack cinder-volume[87204]: WARNING cinder.quota [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1248704808 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1248704808, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['b197c97a-743d-4f51-828d-c177bdb50470', '50eae688-b54e-4a9c-bd1b-a4bc1a3af07e', 'ab9b1d0e-7052-4e9d-bc87-e2b93d39bf4e', '1e385763-55dc-4a50-964f-ddf5960c706b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:04 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 1073741824" returned: 0 in 1.355s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:04 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 Jul 09 16:45:04 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (5d7a2371-6364-45f6-9044-00355248036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f74dc9-f160-428a-9542-831fc4a19690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f74dc9-f160-428a-9542-831fc4a19690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2135601418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0217f2da-eaf4-4a75-b06e-4889f8559b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:05Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c209c9e-9759-41dc-aacb-39164ffa1fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c209c9e-9759-41dc-aacb-39164ffa1fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e418ca2b-b01a-4128-9cd2-d4f4cad547ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e418ca2b-b01a-4128-9cd2-d4f4cad547ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0217f2da-eaf4-4a75-b06e-4889f8559b59', 'volume_name': 'volume-0217f2da-eaf4-4a75-b06e-4889f8559b59', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e532d86c-292e-41e8-983d-55c79ac30f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e532d86c-292e-41e8-983d-55c79ac30f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a13be5-8d4c-408a-9a99-e85d74bf7947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Volume 0217f2da-eaf4-4a75-b06e-4889f8559b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0217f2da-eaf4-4a75-b06e-4889f8559b59', 'volume_size': 1} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['0960069c-a6c1-4b94-837a-df96a45af332', '2d95ad37-ce6d-4861-b368-a6d6084c5ad9', 'dd9ae17f-3e10-41a0-a1e3-a1b51f4e191b', '2b2bf072-ca0b-4366-b0ea-c36731429fb8'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-003ab327-a498-49dc-8e57-a1cae70a7257 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot fae49d17-f875-4e1a-8d19-97e5c825d8fb: deleted successfully Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (42bd8a3e-d2e7-4fe3-b32c-c1bbf60eba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625f6ca5-34f9-462d-958a-e615d24ba7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625f6ca5-34f9-462d-958a-e615d24ba7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-275817153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88b4da7-6497-4985-a4d6-3206aa195227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:05Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57d6ddd-cf77-47b6-8533-77784e15309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57d6ddd-cf77-47b6-8533-77784e15309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481fad6b-4bf0-40b4-93ca-56ff1a5122db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481fad6b-4bf0-40b4-93ca-56ff1a5122db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88b4da7-6497-4985-a4d6-3206aa195227', 'volume_name': 'volume-a88b4da7-6497-4985-a4d6-3206aa195227', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348bcb10-e5f0-4105-a5c0-f7712060ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348bcb10-e5f0-4105-a5c0-f7712060ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b685585-d5d7-48ee-b944-283de45fac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Volume a88b4da7-6497-4985-a4d6-3206aa195227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88b4da7-6497-4985-a4d6-3206aa195227', 'volume_size': 1} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:05 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.813s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428176704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b6a24c-30c5-4353-9eb0-8629d139e81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:03Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Creating volume 28b6a24c-30c5-4353-9eb0-8629d139e81e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:05 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edd6c0a-207c-42a5-8ffe-50c499c29c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:05 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e 1073741824 Jul 09 16:45:05 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e830338-d29b-4c00-b0a5-4b1fb64dc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Volume volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 (38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61): created successfully Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e830338-d29b-4c00-b0a5-4b1fb64dc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (f50b5cb4-bcaf-4927-a13f-f954477428a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-de03d9fb-31be-4437-a1d6-a86af843150f tempest-CreateVolumesFromImageTest-924445167 None] Created volume successfully. Jul 09 16:45:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" acquired by "delete_volume" :: waited 0.054s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[340fab9a-f7a6-47dd-86b7-944606f27a78]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:06 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b Jul 09 16:45:06 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:06 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e 1073741824" returned: 0 in 1.040s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:06 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e Jul 09 16:45:06 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:07 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" returned: 0 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:07 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b Jul 09 16:45:07 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:07 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.966s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-162009374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aba17c-497c-456d-b93c-c90a42c085bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:04Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Creating volume a9aba17c-497c-456d-b93c-c90a42c085bb {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:07 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10869b2-9490-4c62-a07f-eb9b5ee10bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b6a24c-30c5-4353-9eb0-8629d139e81e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d30d72-cf2a-44ff-ab6a-5ce7f3803097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:07 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb 1073741824 Jul 09 16:45:07 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Volume volume-28b6a24c-30c5-4353-9eb0-8629d139e81e (28b6a24c-30c5-4353-9eb0-8629d139e81e): created successfully Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d30d72-cf2a-44ff-ab6a-5ce7f3803097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (42eed165-eaaf-4e8e-bdee-929a6abf4e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-767032a7-1c31-4bde-9030-a536678ade5e tempest-CreateVolumesFromImageTest-924445167 None] Created volume successfully. Jul 09 16:45:07 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" returned: 0 in 0.696s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-58208fe6-8c56-47ae-9f2b-daa1d2a4043b" released by "delete_volume" :: held 1.669s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dc2326-5bf3-41e7-bd38-64d6c6af9dc2]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:08 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc Jul 09 16:45:08 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:08 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb 1073741824" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:08 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb Jul 09 16:45:08 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:08 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" returned: 0 in 0.912s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:08 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc Jul 09 16:45:08 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:09 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.257s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2135601418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0217f2da-eaf4-4a75-b06e-4889f8559b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:05Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Creating volume 0217f2da-eaf4-4a75-b06e-4889f8559b59 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:09 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:09 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 1073741824 Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58b1c84-b4fe-420f-a023-4066ebf7a900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9aba17c-497c-456d-b93c-c90a42c085bb', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:09 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032e2f0a-2de2-4c58-b943-f86451c48481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Volume volume-a9aba17c-497c-456d-b93c-c90a42c085bb (a9aba17c-497c-456d-b93c-c90a42c085bb): created successfully Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032e2f0a-2de2-4c58-b943-f86451c48481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (0cda22f8-fd87-433b-b8a3-314fbd0d3de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-be839c51-6a96-40a1-87f4-9acd025812ef tempest-CreateVolumesFromImageTest-924445167 None] Created volume successfully. Jul 09 16:45:09 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-c76b9f0f-62a3-4942-9616-d6d6d2f9b8dc" released by "delete_volume" :: held 1.680s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['4d901903-8738-4c82-a486-5f3f29d12d45'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:09 devstack cinder-volume[87204]: WARNING cinder.quota [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1248704808 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1248704808, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['694f7020-fbb4-4b12-9346-fa56b9df8133', '3a69bb0d-e676-4b95-80db-5f98cb6fc807', '71314c9f-9789-4b2e-9454-7bc6b7d84e08', 'a9795fe8-1e7a-4ba8-b8e0-9dcb10af9472'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['00f7cdf6-1057-4df1-acd5-8919e87ca93c', 'd342fded-92ab-4e7a-a33f-79d9d31f38aa', 'e047c75e-384a-468b-a5fb-57ebcbb21001', 'c24b2c3d-c02f-44a1-9c58-cffdd2f8ddc4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:10 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:10 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:10 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 1073741824" returned: 0 in 1.013s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:10 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 Jul 09 16:45:10 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:10 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5b9d5012-ac79-4300-90c0-7130a71e8071 tempest-GroupSnapshotsTest-1237295949 None] Delete group completed successfully. Jul 09 16:45:10 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.674s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-275817153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88b4da7-6497-4985-a4d6-3206aa195227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf45517b93ed489a8b28e41389ed17aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:05Z,use_quota=True,user_id='e1d297b1d1fc4b19a3feffc6ee5d9498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Creating volume a88b4da7-6497-4985-a4d6-3206aa195227 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:10 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:11 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 1073741824 Jul 09 16:45:11 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a13be5-8d4c-408a-9a99-e85d74bf7947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0217f2da-eaf4-4a75-b06e-4889f8559b59', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942bd869-158b-451d-a104-c21548e7f5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:11 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Volume volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 (0217f2da-eaf4-4a75-b06e-4889f8559b59): created successfully Jul 09 16:45:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942bd869-158b-451d-a104-c21548e7f5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (5d7a2371-6364-45f6-9044-00355248036d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c9f04edd-70da-479b-b9eb-34b012e00762 tempest-CreateVolumesFromImageTest-924445167 None] Created volume successfully. Jul 09 16:45:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d0871ccc-9070-49f4-b05b-f43d0250452e tempest-GroupSnapshotsTest-1237295949 None] Group tempest-GroupSnapshotsTest-Group-997107762: creating Jul 09 16:45:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d0871ccc-9070-49f4-b05b-f43d0250452e tempest-GroupSnapshotsTest-1237295949 None] Group tempest-GroupSnapshotsTest-Group-997107762: created successfully Jul 09 16:45:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d0871ccc-9070-49f4-b05b-f43d0250452e tempest-GroupSnapshotsTest-1237295949 None] Create group completed successfully. Jul 09 16:45:11 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 1073741824" returned: 0 in 0.919s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:11 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 Jul 09 16:45:11 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:12 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227" returned: 0 in 0.693s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b685585-d5d7-48ee-b944-283de45fac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88b4da7-6497-4985-a4d6-3206aa195227', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee5b924-2850-420d-9f88-277625d02fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Volume volume-a88b4da7-6497-4985-a4d6-3206aa195227 (a88b4da7-6497-4985-a4d6-3206aa195227): created successfully Jul 09 16:45:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee5b924-2850-420d-9f88-277625d02fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Flow 'volume_create_manager' (42bd8a3e-d2e7-4fe3-b32c-c1bbf60eba66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0bf640f0-00b2-4780-8958-cd93c70c3c39 tempest-CreateVolumesFromImageTest-924445167 None] Created volume successfully. Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-a88b4da7-6497-4985-a4d6-3206aa195227-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-a88b4da7-6497-4985-a4d6-3206aa195227-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-quobyte-a88b4da7-6497-4985-a4d6-3206aa195227" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-a88b4da7-6497-4985-a4d6-3206aa195227" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f07117a-70d8-4d1d-af5d-d10d0ff8a317]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:13 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 Jul 09 16:45:13 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (fb673b13-c16b-49b6-9891-4e2c0ed71b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6d025c-b9f0-4754-b9c2-6f9e62a10361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6d025c-b9f0-4754-b9c2-6f9e62a10361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858441068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b0c5c76-6c0a-4584-b32e-3cbab45e5501,host='devstack@QuobyteHD#QuobyteHD',id=4181109d-db00-4567-be0c-37bf23a1aef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:13Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a81a4656-3af5-403c-95be-0bdaec48bb3d),volume_type_id=a81a4656-3af5-403c-95be-0bdaec48bb3d)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c6e4b4-395c-4ef3-84df-4fb95ffb6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c6e4b4-395c-4ef3-84df-4fb95ffb6816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8cd9e5-e035-41ab-8c0d-cdb6fa1bf447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8cd9e5-e035-41ab-8c0d-cdb6fa1bf447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4181109d-db00-4567-be0c-37bf23a1aef5', 'volume_name': 'volume-4181109d-db00-4567-be0c-37bf23a1aef5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441e574d-dea3-4003-a132-9f14ebdb013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441e574d-dea3-4003-a132-9f14ebdb013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349f29d7-9cbf-4716-b8a0-a16fa9702568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Volume 4181109d-db00-4567-be0c-37bf23a1aef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4181109d-db00-4567-be0c-37bf23a1aef5', 'volume_size': 1} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b0c5c76-6c0a-4584-b32e-3cbab45e5501,created_at=2026-07-09T14:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858441068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b0c5c76-6c0a-4584-b32e-3cbab45e5501,host='devstack@QuobyteHD#QuobyteHD',id=4181109d-db00-4567-be0c-37bf23a1aef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c275a34d844825a0bf1a6f534a6ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:13Z,use_quota=True,user_id='53b97bc4b1834f21a9d6ce888061ac81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a81a4656-3af5-403c-95be-0bdaec48bb3d),volume_type_id=a81a4656-3af5-403c-95be-0bdaec48bb3d)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Creating volume 4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:13 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:13 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 1073741824 Jul 09 16:45:13 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:13 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:14 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227 Jul 09 16:45:14 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:14 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 1073741824" returned: 0 in 0.925s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:14 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 Jul 09 16:45:14 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:14 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a88b4da7-6497-4985-a4d6-3206aa195227" returned: 0 in 0.736s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-a88b4da7-6497-4985-a4d6-3206aa195227" released by "delete_volume" :: held 1.602s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Created reservations ['f200ccb7-3f53-4c8f-bf19-02300d4373e0', '4aa1861a-eba4-4bb8-8c42-3aebf6a3db8e', '3eeebbad-df04-4249-bff0-bbd04882965a', '39831713-f3cd-40b1-b73e-5e9672e27815'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:14 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:14 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:15 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349f29d7-9cbf-4716-b8a0-a16fa9702568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4181109d-db00-4567-be0c-37bf23a1aef5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503b7721-d84b-42ea-8cb6-c6668be0ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Volume volume-4181109d-db00-4567-be0c-37bf23a1aef5 (4181109d-db00-4567-be0c-37bf23a1aef5): created successfully Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503b7721-d84b-42ea-8cb6-c6668be0ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Flow 'volume_create_manager' (fb673b13-c16b-49b6-9891-4e2c0ed71b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2153bab8-5941-499d-9608-8c79ab5ad3c9 tempest-GroupSnapshotsTest-1237295949 None] Created volume successfully. Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-0217f2da-eaf4-4a75-b06e-4889f8559b59-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-0217f2da-eaf4-4a75-b06e-4889f8559b59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-quobyte-0217f2da-eaf4-4a75-b06e-4889f8559b59" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-0217f2da-eaf4-4a75-b06e-4889f8559b59" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2968708e-33dd-418b-a3a6-66270569e7e8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:15 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 Jul 09 16:45:15 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:15 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.820s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Deleted volume successfully. Jul 09 16:45:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-305ae2fe-1c3a-4b56-9cb7-a0cf9f24369b tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-a88b4da7-6497-4985-a4d6-3206aa195227-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] GroupSnapshot 34c26c71-f605-4100-a670-d2256ad506d2: creating. Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Group snapshot 34c26c71-f605-4100-a670-d2256ad506d2: creating. {{(pid=87204) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Creating offline snapshot 70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 of volume 4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f848c263-7542-4716-aa29-7f15fd5d70e4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:16 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 Jul 09 16:45:16 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:16 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59" returned: 0 in 0.861s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:16 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59 Jul 09 16:45:16 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:16 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:17 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 1G Jul 09 16:45:17 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:17 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0217f2da-eaf4-4a75-b06e-4889f8559b59" returned: 0 in 0.711s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-0217f2da-eaf4-4a75-b06e-4889f8559b59" released by "delete_volume" :: held 1.624s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Created reservations ['78626e17-a1c3-4cbc-999c-9ab798a0039b', '4f95b347-4bf2-47ab-85aa-a401b768959c', '021a3957-886d-4221-8def-8e93a9025879', '2260265c-91a1-4bf5-b947-c6fb9f62c4bc'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:17 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:17 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-a9aba17c-497c-456d-b93c-c90a42c085bb-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-a9aba17c-497c-456d-b93c-c90a42c085bb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-quobyte-a9aba17c-497c-456d-b93c-c90a42c085bb" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-a9aba17c-497c-456d-b93c-c90a42c085bb" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9516f2-9a06-49fb-8172-e4bfb6021261]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:17 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb Jul 09 16:45:17 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:17 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Deleted volume successfully. Jul 09 16:45:17 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 1G" returned: 0 in 0.939s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4181109d-db00-4567-be0c-37bf23a1aef5 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b6807745-a257-4b21-a6f8-74bdf28790eb tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-0217f2da-eaf4-4a75-b06e-4889f8559b59-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:17 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4181109d-db00-4567-be0c-37bf23a1aef5 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 Jul 09 16:45:17 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:18 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:18 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb Jul 09 16:45:18 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:18 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4181109d-db00-4567-be0c-37bf23a1aef5 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:18 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:45:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:18 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 Jul 09 16:45:18 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:19 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a9aba17c-497c-456d-b93c-c90a42c085bb" returned: 0 in 0.682s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-a9aba17c-497c-456d-b93c-c90a42c085bb" released by "delete_volume" :: held 1.620s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Created reservations ['a4e136d9-0659-4dc4-b97d-75cf47046d1f', 'c9bbc555-11fd-4f19-8278-81ba37c54231', 'c8ace974-b3d3-453c-a590-0b2464277136', '21f486ed-e6c5-438f-9cb8-44af1a6ce774'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:19 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" returned: 0 in 0.670s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:19 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.info Jul 09 16:45:19 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:19 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:19 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-28b6a24c-30c5-4353-9eb0-8629d139e81e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-28b6a24c-30c5-4353-9eb0-8629d139e81e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-quobyte-28b6a24c-30c5-4353-9eb0-8629d139e81e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-28b6a24c-30c5-4353-9eb0-8629d139e81e" acquired by "delete_volume" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0be3b-e410-40ef-911b-8e0d6bc6a2d7]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:20 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e Jul 09 16:45:20 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:20 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.info" returned: 0 in 1.104s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:20 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:20 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.info Jul 09 16:45:20 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:20 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.093s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Deleted volume successfully. Jul 09 16:45:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2ccb7dce-987b-4fe2-96d9-3e433eb57323 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-a9aba17c-497c-456d-b93c-c90a42c085bb-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:21 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e" returned: 0 in 0.990s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:21 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e Jul 09 16:45:21 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:21 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.info" returned: 0 in 0.710s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.157s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-290f4537-9f99-4ae6-bd51-dea2c97d90e4 tempest-GroupSnapshotsTest-1237295949 None] group_snapshot 34c26c71-f605-4100-a670-d2256ad506d2: created successfully Jul 09 16:45:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] group_snapshot 34c26c71-f605-4100-a670-d2256ad506d2: deleting Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] group_snapshot 34c26c71-f605-4100-a670-d2256ad506d2: deleting {{(pid=87204) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-4181109d-db00-4567-be0c-37bf23a1aef5" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-4181109d-db00-4567-be0c-37bf23a1aef5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Deleting offline snapshot 70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 of volume 4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] snapshot_file for this snap is: volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485e7db-5f28-40a5-8636-f3cd74de10aa]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:21 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 Jul 09 16:45:21 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:21 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-28b6a24c-30c5-4353-9eb0-8629d139e81e" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-28b6a24c-30c5-4353-9eb0-8629d139e81e" released by "delete_volume" :: held 1.844s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:21 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Created reservations ['3eb65f90-f825-4976-975d-6fbe0a642bc1', 'b5518d8d-2fe3-4f78-8a8c-d4e50efa7037', 'dea8bea4-fea5-4fd3-aa16-31b4ad7aa614', 'de9160c6-a590-40a4-adcc-4166a2064a5b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:22 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:22 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "cinder-quobyte-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8ba08-26e5-429e-b40c-11e4d70e3098]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:22 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 Jul 09 16:45:22 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:22 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" returned: 0 in 0.971s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4181109d-db00-4567-be0c-37bf23a1aef5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d7a40f-6b96-4082-a866-ba632829b65c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:22 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 Jul 09 16:45:22 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:23 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:23 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Deleted volume successfully. Jul 09 16:45:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ac3cadb5-2758-44eb-97c4-7c9d68653f23 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-28b6a24c-30c5-4353-9eb0-8629d139e81e-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:23 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61" returned: 0 in 0.968s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:23 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61 Jul 09 16:45:23 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:23 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5" returned: 0 in 0.927s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:23 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 Jul 09 16:45:23 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:24 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61" returned: 0 in 0.699s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-quobyte-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61" released by "delete_volume" :: held 1.725s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Created reservations ['2097e923-5f7c-4635-818a-9f226d507fd7', '0d58470f-4639-4b36-bdb4-bd4a59d4b2f5', 'a2ad9a6c-eb46-4d08-9a31-b96c69fa0e7d', '896bde27-d16e-4e55-a94a-0bca652d98ab'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:24 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:24 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:24 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" returned: 0 in 0.813s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:24 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0 Jul 09 16:45:24 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:25 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Deleted volume successfully. Jul 09 16:45:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b76af132-03db-4a06-9d74-3625a82e5df8 tempest-CreateVolumesFromImageTest-924445167 None] Lock "cinder-38e8cc6e-f2bd-40b8-a5d7-bf2b9eb48e61-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:25 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5.70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-70d5f82d-c3f2-4250-a30e-3a3b9de28ae0" released by "_delete_snapshot" :: held 3.661s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-4181109d-db00-4567-be0c-37bf23a1aef5" released by "delete_snapshot" :: held 3.687s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:25 devstack cinder-volume[87204]: WARNING cinder.quota [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1988612692 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1988612692, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:25 devstack cinder-volume[87204]: WARNING cinder.quota [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1988612692 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1988612692, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['63d59c08-611b-49d2-9334-42ca4cf8a721', 'ddcd029b-92ee-4a6c-9fd7-e4b98172ba43', '1aaef2a9-fef4-4525-9b7b-5ff76d815871', '90a010db-1ae8-4c1e-8247-5a041d924e94'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6262ad8d-9b62-43bd-9887-758c822fb4cd tempest-GroupSnapshotsTest-1237295949 None] group_snapshot 34c26c71-f605-4100-a670-d2256ad506d2: deleted successfully Jul 09 16:45:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "cinder-quobyte-4181109d-db00-4567-be0c-37bf23a1aef5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-4181109d-db00-4567-be0c-37bf23a1aef5" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97431fb-6511-49dd-a860-94f7679ae1f4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:26 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 Jul 09 16:45:26 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:27 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5" returned: 0 in 0.861s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:27 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5 Jul 09 16:45:27 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (d232ec5c-b5c8-47e8-8ba9-a978397bb293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41782cdd-fa29-44cf-8c00-8638a7dc81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41782cdd-fa29-44cf-8c00-8638a7dc81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37512298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bb09c4-a159-4fd3-a752-904e025aecb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:28Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fda7a1-2c1b-4b57-beb9-d534e80a2ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fda7a1-2c1b-4b57-beb9-d534e80a2ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332fb4b1-9770-4ff0-8a95-ad219fa141aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332fb4b1-9770-4ff0-8a95-ad219fa141aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1bb09c4-a159-4fd3-a752-904e025aecb1', 'volume_name': 'volume-b1bb09c4-a159-4fd3-a752-904e025aecb1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8802be33-e113-4990-acc4-0228210bed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8802be33-e113-4990-acc4-0228210bed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a8e04a-b55d-47df-a903-37f29ef2c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:27 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume b1bb09c4-a159-4fd3-a752-904e025aecb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1bb09c4-a159-4fd3-a752-904e025aecb1', 'volume_size': 1} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37512298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bb09c4-a159-4fd3-a752-904e025aecb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:28Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Creating volume b1bb09c4-a159-4fd3-a752-904e025aecb1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:27 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:27 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 1073741824 Jul 09 16:45:27 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:28 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4181109d-db00-4567-be0c-37bf23a1aef5" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Lock "cinder-quobyte-4181109d-db00-4567-be0c-37bf23a1aef5" released by "delete_volume" :: held 1.778s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['0c5e569f-f551-44eb-b48d-8154c67963be'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:28 devstack cinder-volume[87204]: WARNING cinder.quota [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1988612692 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1988612692, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Created reservations ['311427c2-2ed0-476e-8c9a-a3181d2d7027', '396986d8-a2b1-4263-84f6-9aafb1aeb1b4', '5d6f8aae-ac82-48c3-9bbd-61bced6fe39e', 'f450da09-fc18-4e0c-b9a3-db009adf3eba'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:28 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:28 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:28 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:28 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:28 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 1073741824" returned: 0 in 0.950s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:28 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 Jul 09 16:45:28 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:29 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fe00fb1a-8278-4048-a834-1d1b07987a20 tempest-GroupSnapshotsTest-1237295949 None] Delete group completed successfully. Jul 09 16:45:29 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.872s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:45:29 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1" returned: 0 in 0.865s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a8e04a-b55d-47df-a903-37f29ef2c221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1bb09c4-a159-4fd3-a752-904e025aecb1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cdd17d-fa3d-4347-a9fd-713b77dc311f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 (b1bb09c4-a159-4fd3-a752-904e025aecb1): created successfully Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cdd17d-fa3d-4347-a9fd-713b77dc311f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (d232ec5c-b5c8-47e8-8ba9-a978397bb293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-57478a52-113e-4292-aa28-1d32e15fb0fc tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created volume successfully. Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (1340523f-dfa8-4f3c-9fc5-8f06cf3c3bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b023df6-1bb3-40f0-8b4b-95a879d00046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b023df6-1bb3-40f0-8b4b-95a879d00046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410291250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dac98b-2e52-402d-9b16-e60f39873353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:31Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f9c23c-d985-49aa-b7cc-e421567ae98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f9c23c-d985-49aa-b7cc-e421567ae98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87714f88-ba5e-4bbb-96e9-ae4bec869172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87714f88-ba5e-4bbb-96e9-ae4bec869172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8dac98b-2e52-402d-9b16-e60f39873353', 'volume_name': 'volume-a8dac98b-2e52-402d-9b16-e60f39873353', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5885373a-04fd-4754-9143-4006fb215ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5885373a-04fd-4754-9143-4006fb215ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda3c8b7-b8e5-419b-b020-5ad4aceb54b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume a8dac98b-2e52-402d-9b16-e60f39873353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8dac98b-2e52-402d-9b16-e60f39873353', 'volume_size': 1} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410291250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dac98b-2e52-402d-9b16-e60f39873353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:31Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Creating volume a8dac98b-2e52-402d-9b16-e60f39873353 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:31 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:31 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 1073741824 Jul 09 16:45:31 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (abecea26-26d9-499a-ae25-d7fe106cf769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241c7e55-3e35-48c9-90a3-aa26752b9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241c7e55-3e35-48c9-90a3-aa26752b9232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544271297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b95540d-1ded-4a89-a05c-fe4d5fe2d313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:32Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e705d-a7c8-440f-890d-a73976ca382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e705d-a7c8-440f-890d-a73976ca382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94baabe9-2935-4d0c-843e-6bfc0ffc4101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94baabe9-2935-4d0c-843e-6bfc0ffc4101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b95540d-1ded-4a89-a05c-fe4d5fe2d313', 'volume_name': 'volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef40fb7f-a64b-4137-84e4-abe3789dfa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef40fb7f-a64b-4137-84e4-abe3789dfa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3c0fd9-fbfa-4d10-ad12-65f4e94e37af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume 8b95540d-1ded-4a89-a05c-fe4d5fe2d313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313', 'volume_size': 1} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (b8c53241-7022-4990-825d-082f9ee957d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468aa086-c5a8-47db-986e-d35bc24cb5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468aa086-c5a8-47db-986e-d35bc24cb5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165300916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee5ddf9-4dd0-424c-ac0b-976fc1aef864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:33Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2fa3e-48d3-4a62-b333-30d6cabeca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a2fa3e-48d3-4a62-b333-30d6cabeca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38771f8-a303-406c-835e-6cab13a24abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38771f8-a303-406c-835e-6cab13a24abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee5ddf9-4dd0-424c-ac0b-976fc1aef864', 'volume_name': 'volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7edbe8d-50d3-4169-a08e-7a2e358914f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7edbe8d-50d3-4169-a08e-7a2e358914f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1174840-fcf1-40ec-a645-8dd05198590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume eee5ddf9-4dd0-424c-ac0b-976fc1aef864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864', 'volume_size': 1} Jul 09 16:45:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:33 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 1073741824" returned: 0 in 1.504s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:33 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 Jul 09 16:45:33 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (f22bb3bc-8e43-4f93-a081-9d6b11443784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0d9d45-95d2-46e1-ab81-4c75dc8ec3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0d9d45-95d2-46e1-ab81-4c75dc8ec3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217969872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5f1440-e0ba-4c15-944d-07e6c1d42f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:33Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f48cafa-59a7-4f02-a6f2-4b5611922d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f48cafa-59a7-4f02-a6f2-4b5611922d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfef30a-b7fa-422f-a7f0-409bea514a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfef30a-b7fa-422f-a7f0-409bea514a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5f1440-e0ba-4c15-944d-07e6c1d42f22', 'volume_name': 'volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03340e3-5207-4b3e-827f-a46c92ef4bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03340e3-5207-4b3e-827f-a46c92ef4bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ba4f97-357c-4333-8fec-a1bd424fa481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume 5e5f1440-e0ba-4c15-944d-07e6c1d42f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22', 'volume_size': 1} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (d5af3eeb-e699-4998-8a6b-cf9ab34a1964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4ead94-9f99-4958-a7bb-d8a69d8e00b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4ead94-9f99-4958-a7bb-d8a69d8e00b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1541957964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4a39e8-8d64-42ff-80c0-1d9fd69404df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:34Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e9c6af-56cf-4730-ab48-0b287f5a392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e9c6af-56cf-4730-ab48-0b287f5a392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84848e0-5aaf-4f51-8d1e-02ccc76a224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84848e0-5aaf-4f51-8d1e-02ccc76a224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4a39e8-8d64-42ff-80c0-1d9fd69404df', 'volume_name': 'volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd37918-e023-40aa-b9f7-9de9a6e25696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd37918-e023-40aa-b9f7-9de9a6e25696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b75893-e3c9-4e93-b26f-c194c25fb554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume ae4a39e8-8d64-42ff-80c0-1d9fd69404df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df', 'volume_size': 1} Jul 09 16:45:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:34 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353" returned: 0 in 0.921s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] <== create_volume: return (2495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-544271297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b95540d-1ded-4a89-a05c-fe4d5fe2d313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:32Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Creating volume 8b95540d-1ded-4a89-a05c-fe4d5fe2d313 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:34 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda3c8b7-b8e5-419b-b020-5ad4aceb54b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8dac98b-2e52-402d-9b16-e60f39873353', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:34 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 1073741824 Jul 09 16:45:34 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05113cc-c443-4cc8-9dc3-783a2028b020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume volume-a8dac98b-2e52-402d-9b16-e60f39873353 (a8dac98b-2e52-402d-9b16-e60f39873353): created successfully Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05113cc-c443-4cc8-9dc3-783a2028b020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (1340523f-dfa8-4f3c-9fc5-8f06cf3c3bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5a0eac13-9637-467c-b907-a8dd18079388 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created volume successfully. Jul 09 16:45:35 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 1073741824" returned: 0 in 1.103s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:35 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 Jul 09 16:45:35 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a1d0a67c-368b-463b-ae39-04724118f836 tempest-GroupsTest-1870933033 None] Group tempest-Group1-1932886751: creating Jul 09 16:45:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a1d0a67c-368b-463b-ae39-04724118f836 tempest-GroupsTest-1870933033 None] Group tempest-Group1-1932886751: created successfully Jul 09 16:45:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a1d0a67c-368b-463b-ae39-04724118f836 tempest-GroupsTest-1870933033 None] Create group completed successfully. Jul 09 16:45:36 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313" returned: 0 in 0.762s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-165300916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee5ddf9-4dd0-424c-ac0b-976fc1aef864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:33Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Creating volume eee5ddf9-4dd0-424c-ac0b-976fc1aef864 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:36 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:36 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 1073741824 Jul 09 16:45:36 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3c0fd9-fbfa-4d10-ad12-65f4e94e37af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7fe967-1804-4aaa-b62c-cfdac2b6ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 (8b95540d-1ded-4a89-a05c-fe4d5fe2d313): created successfully Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7fe967-1804-4aaa-b62c-cfdac2b6ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (abecea26-26d9-499a-ae25-d7fe106cf769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-101044d4-07b5-447c-9017-6d6c51e2b61b tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created volume successfully. Jul 09 16:45:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-02d92bec-1051-4f53-bce5-3515731a27b1 tempest-GroupsTest-1870933033 None] Group tempest-Group2-1466952448: creating Jul 09 16:45:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-02d92bec-1051-4f53-bce5-3515731a27b1 tempest-GroupsTest-1870933033 None] Group tempest-Group2-1466952448: created successfully Jul 09 16:45:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-02d92bec-1051-4f53-bce5-3515731a27b1 tempest-GroupsTest-1870933033 None] Create group completed successfully. Jul 09 16:45:37 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 1073741824" returned: 0 in 1.019s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:37 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 Jul 09 16:45:37 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:37 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.470s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217969872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5f1440-e0ba-4c15-944d-07e6c1d42f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:33Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Creating volume 5e5f1440-e0ba-4c15-944d-07e6c1d42f22 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:37 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:37 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 1073741824 Jul 09 16:45:37 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1174840-fcf1-40ec-a645-8dd05198590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae3c21c-7abb-4700-aafc-eff0e3a5ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:37 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 (eee5ddf9-4dd0-424c-ac0b-976fc1aef864): created successfully Jul 09 16:45:37 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae3c21c-7abb-4700-aafc-eff0e3a5ce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (b8c53241-7022-4990-825d-082f9ee957d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9669e204-eaeb-4b8b-ab5f-4987f2ffa380 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created volume successfully. Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Flow 'volume_create_manager' (cc0de621-3aef-47d3-a744-ecccd38bbb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc714ad9-22ee-4a66-b4a7-04af9e48d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc714ad9-22ee-4a66-b4a7-04af9e48d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-87171700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3712f01d-cd19-4e26-a754-3e29377ab4e2,host='devstack@QuobyteHD#QuobyteHD',id=94db28e3-e9db-44d9-8946-1c97f63880a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f735d153ab54af79d32d3f508573ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:39Z,use_quota=True,user_id='3e22c46715f84b229a15ef4d642416a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdc28e81-7851-4939-b69a-161a5d839e12),volume_type_id=fdc28e81-7851-4939-b69a-161a5d839e12)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb55d587-8591-4dce-a06d-94e1cab213d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb55d587-8591-4dce-a06d-94e1cab213d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465433d8-7e96-4085-afb4-a3ad5df745d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465433d8-7e96-4085-afb4-a3ad5df745d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94db28e3-e9db-44d9-8946-1c97f63880a2', 'volume_name': 'volume-94db28e3-e9db-44d9-8946-1c97f63880a2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fff9e4-8453-4c20-ba26-8fa73b38bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fff9e4-8453-4c20-ba26-8fa73b38bc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a56746-cf97-4512-8b56-8ca377d4360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Volume 94db28e3-e9db-44d9-8946-1c97f63880a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94db28e3-e9db-44d9-8946-1c97f63880a2', 'volume_size': 1} Jul 09 16:45:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:39 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 1073741824" returned: 0 in 1.178s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:39 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 Jul 09 16:45:39 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:39 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22" returned: 0 in 0.684s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.933s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1541957964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4a39e8-8d64-42ff-80c0-1d9fd69404df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f1f94639e445a0aa0fa9273b3deed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:34Z,use_quota=True,user_id='ae4b2409a1c944cb82bda553bdd21560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Creating volume ae4a39e8-8d64-42ff-80c0-1d9fd69404df {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:39 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ba4f97-357c-4333-8fec-a1bd424fa481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:39 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df 1073741824 Jul 09 16:45:39 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4920d4-bd3c-4d51-a167-ab766c2916c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 (5e5f1440-e0ba-4c15-944d-07e6c1d42f22): created successfully Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4920d4-bd3c-4d51-a167-ab766c2916c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (f22bb3bc-8e43-4f93-a081-9d6b11443784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5c5a6b6d-03ac-4426-97de-261efb9ae061 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created volume successfully. Jul 09 16:45:40 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df 1073741824" returned: 0 in 0.922s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:40 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df Jul 09 16:45:40 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:41 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df" returned: 0 in 0.680s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3712f01d-cd19-4e26-a754-3e29377ab4e2,created_at=2026-07-09T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-87171700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3712f01d-cd19-4e26-a754-3e29377ab4e2,host='devstack@QuobyteHD#QuobyteHD',id=94db28e3-e9db-44d9-8946-1c97f63880a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f735d153ab54af79d32d3f508573ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:39Z,use_quota=True,user_id='3e22c46715f84b229a15ef4d642416a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdc28e81-7851-4939-b69a-161a5d839e12),volume_type_id=fdc28e81-7851-4939-b69a-161a5d839e12)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Creating volume 94db28e3-e9db-44d9-8946-1c97f63880a2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:41 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b75893-e3c9-4e93-b26f-c194c25fb554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:41 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 1073741824 Jul 09 16:45:41 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c36fa9-7afc-4358-a9f1-7199709b38c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Volume volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df (ae4a39e8-8d64-42ff-80c0-1d9fd69404df): created successfully Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c36fa9-7afc-4358-a9f1-7199709b38c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Flow 'volume_create_manager' (d5af3eeb-e699-4998-8a6b-cf9ab34a1964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9064a2ef-cd5c-4e80-a3d3-2ead43405012 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created volume successfully. Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Flow 'volume_create_manager' (0cf91a8c-9c00-496f-bbd3-e3924e84101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3a1550-6bc5-4536-b126-4695ac2baa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3a1550-6bc5-4536-b126-4695ac2baa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1314881663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bd2259-884e-4a3c-afc3-ecc6fe475238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fed546d5fe4898a213bd5c11f1beef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:42Z,use_quota=True,user_id='661c5eab51e64b0992d57eddafce3794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872bf37b-36e6-4322-9d55-bfa4bc427eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872bf37b-36e6-4322-9d55-bfa4bc427eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da54324c-e487-4732-b616-2404b4114db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:45:42 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 1073741824" returned: 0 in 0.910s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:42 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 Jul 09 16:45:42 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da54324c-e487-4732-b616-2404b4114db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76bd2259-884e-4a3c-afc3-ecc6fe475238', 'volume_name': 'volume-76bd2259-884e-4a3c-afc3-ecc6fe475238', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4609ba7b-b7dd-4b6e-a768-79a43502034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4609ba7b-b7dd-4b6e-a768-79a43502034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abad5487-0f24-4f65-8d64-69a91ae4982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Volume 76bd2259-884e-4a3c-afc3-ecc6fe475238: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76bd2259-884e-4a3c-afc3-ecc6fe475238', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Trying to clone 76bd2259-884e-4a3c-afc3-ecc6fe475238 from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-ae4a39e8-8d64-42ff-80c0-1d9fd69404df-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-ae4a39e8-8d64-42ff-80c0-1d9fd69404df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-quobyte-ae4a39e8-8d64-42ff-80c0-1d9fd69404df" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-ae4a39e8-8d64-42ff-80c0-1d9fd69404df" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5501043-d254-4087-a1db-1cd0883e2fc0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:42 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:45:42 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Image download 20.69 MB at 20.69 MB/s Jul 09 16:45:42 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df Jul 09 16:45:42 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a666cd4-89a5-4d29-8239-49c220b007a5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:43 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD Jul 09 16:45:43 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:43 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a56746-cf97-4512-8b56-8ca377d4360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94db28e3-e9db-44d9-8946-1c97f63880a2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd6d1d8-94fb-4e40-85d6-6afb47590152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Volume volume-94db28e3-e9db-44d9-8946-1c97f63880a2 (94db28e3-e9db-44d9-8946-1c97f63880a2): created successfully Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd6d1d8-94fb-4e40-85d6-6afb47590152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Flow 'volume_create_manager' (cc0de621-3aef-47d3-a744-ecccd38bbb97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dde7efd2-12f8-45c6-9834-e05f36e46040 tempest-GroupsTest-1870933033 None] Created volume successfully. Jul 09 16:45:43 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df" returned: 0 in 0.990s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:43 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 is fetched for user 661c5eab51e64b0992d57eddafce3794. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:45:43 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df Jul 09 16:45:43 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[752bd715-cca1-40ed-b6ca-0ef11a6953b9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:44 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD Jul 09 16:45:44 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Acquiring lock "cinder-quobyte-94db28e3-e9db-44d9-8946-1c97f63880a2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Lock "cinder-quobyte-94db28e3-e9db-44d9-8946-1c97f63880a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[11448941-dd6f-4a4c-9caf-5931a213d58e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:44 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 Jul 09 16:45:44 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:44 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ae4a39e8-8d64-42ff-80c0-1d9fd69404df" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-ae4a39e8-8d64-42ff-80c0-1d9fd69404df" released by "delete_volume" :: held 1.743s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created reservations ['7338ad53-f8fd-4379-badf-cfb3d63d22d6', '552036df-beea-4e33-b90b-a77fe3fa3d9d', '4332aaf1-3a44-4037-b6d9-418ef9ae3625', 'ea28cb9c-d66c-4678-876c-6f735041f79c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:44 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:44 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:44 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1314881663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bd2259-884e-4a3c-afc3-ecc6fe475238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4fed546d5fe4898a213bd5c11f1beef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:42Z,use_quota=True,user_id='661c5eab51e64b0992d57eddafce3794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Creating volume 76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:44 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 1073741824 Jul 09 16:45:44 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-5e5f1440-e0ba-4c15-944d-07e6c1d42f22-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-5e5f1440-e0ba-4c15-944d-07e6c1d42f22-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=175,cinder:SELECT=129,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=142,cinder:UPDATE=165,cinder:INSERT=43,cinder:DELETE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:45:45 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2" returned: 0 in 0.846s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:45 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2 Jul 09 16:45:45 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-quobyte-5e5f1440-e0ba-4c15-944d-07e6c1d42f22" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-5e5f1440-e0ba-4c15-944d-07e6c1d42f22" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7103e1d-60e3-4853-8143-cc017eb7ab54]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:45 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 Jul 09 16:45:45 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:45 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.894s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Deleted volume successfully. Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c6b7cf6e-2d59-4942-bb27-ee1c125ff545 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-ae4a39e8-8d64-42ff-80c0-1d9fd69404df-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:45 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 1073741824" returned: 0 in 0.951s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:45 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:45:45 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:45 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-94db28e3-e9db-44d9-8946-1c97f63880a2" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Lock "cinder-quobyte-94db28e3-e9db-44d9-8946-1c97f63880a2" released by "delete_volume" :: held 1.666s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Created reservations ['4fdafbaa-d6fa-45cb-9a2c-42ca995ca75c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:45 devstack cinder-volume[87204]: WARNING cinder.quota [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1500308058 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1500308058, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:45 devstack cinder-volume[87204]: WARNING cinder.quota [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1500308058 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1500308058, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:45:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Created reservations ['0fce2d09-81d9-478f-b5da-ecab2b34647e', 'd2a19971-4f96-4579-a1c1-b7e2a8b91e72', '6183778b-5342-49dc-bfdd-53dce8b95e5a', '6a8718e3-742a-4b20-93cf-3761793a73cb'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:46 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22" returned: 0 in 0.884s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:46 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:46 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:46 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22 Jul 09 16:45:46 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:46 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 0 in 0.679s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Attempting download of de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 76bd2259-884e-4a3c-afc3-ecc6fe475238. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d3d32-aab9-4041-9071-bb702f5571fe]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_qn2ogay3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:46 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_qn2ogay3 Jul 09 16:45:46 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Created reservations ['572505fc-8cfd-4a6d-af12-55d9c6230640'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:46 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6af9ef22-9db8-4677-85f4-8b7f95a68988 tempest-GroupsTest-1870933033 None] Delete group completed successfully. Jul 09 16:45:46 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:46 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:46 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5e5f1440-e0ba-4c15-944d-07e6c1d42f22" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-5e5f1440-e0ba-4c15-944d-07e6c1d42f22" released by "delete_volume" :: held 1.692s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created reservations ['5e5b28a8-1d76-4704-b5bf-8aea38241b2e', 'e080cb2c-2d3f-4778-b5cc-3d2e73b8887f', '72b1cd34-8f6d-4afe-a673-2ba801d05349', '93acf61e-a9f3-4942-bf40-267f4eeb06cf'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:46 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:46 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-eee5ddf9-4dd0-424c-ac0b-976fc1aef864-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-eee5ddf9-4dd0-424c-ac0b-976fc1aef864-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-quobyte-eee5ddf9-4dd0-424c-ac0b-976fc1aef864" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:47 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-eee5ddf9-4dd0-424c-ac0b-976fc1aef864" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_qn2ogay3" returned: 0 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_qn2ogay3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea47a37f-ce57-415c-9ca7-5e4089005b0b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:47 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_qn2ogay3 Jul 09 16:45:47 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:47 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a83dc0e1-d982-47a6-9ab9-fb7760c872cc tempest-GroupsTest-1870933033 None] Delete group completed successfully. Jul 09 16:45:47 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 Jul 09 16:45:47 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:47 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Deleted volume successfully. Jul 09 16:45:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-18f74aa1-bd99-4eaa-a00f-f4b9b04fd916 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-5e5f1440-e0ba-4c15-944d-07e6c1d42f22-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:48 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_qn2ogay3" returned: 1 in 0.819s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_qn2ogay3' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e41c8d-4c49-42fe-8b5d-fd1af4a44515]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:48 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864" returned: 0 in 0.880s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:48 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864 Jul 09 16:45:48 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3539369e-5431-4111-bc65-f29152938563 tempest-GroupsTest-1870933033 None] Group tempest-GroupsTest-Group-1215664712: creating Jul 09 16:45:48 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD Jul 09 16:45:48 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3539369e-5431-4111-bc65-f29152938563 tempest-GroupsTest-1870933033 None] Group tempest-GroupsTest-Group-1215664712: created successfully Jul 09 16:45:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3539369e-5431-4111-bc65-f29152938563 tempest-GroupsTest-1870933033 None] Create group completed successfully. Jul 09 16:45:48 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eee5ddf9-4dd0-424c-ac0b-976fc1aef864" returned: 0 in 0.652s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-eee5ddf9-4dd0-424c-ac0b-976fc1aef864" released by "delete_volume" :: held 1.592s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:48 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] de3c03b3-c1ea-429a-9d20-5eaeb1379637 was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:45:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:48 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:45:48 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created reservations ['cb0b464d-098f-495d-91f0-060789afd000', '8d05e8ad-58c0-4a7e-894f-4916d9f8b943', 'dea41f74-24e3-4e84-aab5-dcf80d7398fc', 'f79f5ee8-9a4e-42aa-88ab-fc8a3f7b0e35'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:49 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:49 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-8b95540d-1ded-4a89-a05c-fe4d5fe2d313-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-8b95540d-1ded-4a89-a05c-fe4d5fe2d313-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-quobyte-8b95540d-1ded-4a89-a05c-fe4d5fe2d313" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-8b95540d-1ded-4a89-a05c-fe4d5fe2d313" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31de4c4-cf8e-4fc6-a641-004ac86b470c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:49 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 Jul 09 16:45:49 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:49 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:49 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Deleted volume successfully. Jul 09 16:45:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3daacb93-c385-4b7a-8d7a-34d51d248d23 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-eee5ddf9-4dd0-424c-ac0b-976fc1aef864-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Flow 'volume_create_manager' (5df7164f-260c-4c63-a06f-566ccbac9a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f5df86-0366-4936-9e3f-b2f4e73e1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f5df86-0366-4936-9e3f-b2f4e73e1347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268078919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93c51429-f933-42c7-b9bd-36bc5ea6ad1e,host='devstack@QuobyteHD#QuobyteHD',id=9d979d1f-b76f-4381-b7dc-f1e5e514ef99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f735d153ab54af79d32d3f508573ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:50Z,use_quota=True,user_id='3e22c46715f84b229a15ef4d642416a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d870e9-121f-44e1-bf60-4d8be739dd2a),volume_type_id=66d870e9-121f-44e1-bf60-4d8be739dd2a)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0b3f8b-10ae-48c1-99e6-fc5f7ac40c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0b3f8b-10ae-48c1-99e6-fc5f7ac40c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d038b0-13fb-4c6b-9c22-3e0cf349fc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d038b0-13fb-4c6b-9c22-3e0cf349fc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d979d1f-b76f-4381-b7dc-f1e5e514ef99', 'volume_name': 'volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7265d070-59e2-4729-93e4-da653b2cc4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7265d070-59e2-4729-93e4-da653b2cc4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5cdfd2-5d09-421c-ac90-00f77fb48d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Volume 9d979d1f-b76f-4381-b7dc-f1e5e514ef99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99', 'volume_size': 1} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93c51429-f933-42c7-b9bd-36bc5ea6ad1e,created_at=2026-07-09T14:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268078919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93c51429-f933-42c7-b9bd-36bc5ea6ad1e,host='devstack@QuobyteHD#QuobyteHD',id=9d979d1f-b76f-4381-b7dc-f1e5e514ef99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f735d153ab54af79d32d3f508573ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:50Z,use_quota=True,user_id='3e22c46715f84b229a15ef4d642416a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d870e9-121f-44e1-bf60-4d8be739dd2a),volume_type_id=66d870e9-121f-44e1-bf60-4d8be739dd2a)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Creating volume 9d979d1f-b76f-4381-b7dc-f1e5e514ef99 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:50 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 1073741824 Jul 09 16:45:50 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:50 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313" returned: 0 in 0.962s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:50 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313 Jul 09 16:45:50 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:51 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 0 in 2.110s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_pu2s5dtwdevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:45:51 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Converted 112.00 MB image at 53.05 MB/s Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:51 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 1G Jul 09 16:45:51 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:51 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 1073741824" returned: 0 in 0.905s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:51 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 Jul 09 16:45:51 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:51 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8b95540d-1ded-4a89-a05c-fe4d5fe2d313" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-8b95540d-1ded-4a89-a05c-fe4d5fe2d313" released by "delete_volume" :: held 1.797s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created reservations ['a6742d1d-8384-453a-ab0f-6e4c12a6e859', 'c0cd056e-c3e0-4080-94c6-47604f3ca2bc', '4278b4c4-3863-4d01-84d3-f1a33dbeb918', 'd26f48af-e2d1-4202-bf56-5832d40f1e64'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:51 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:51 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:51 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 1G" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac5a6ef-3440-4bf0-a50f-f68d17b6c639]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-a8dac98b-2e52-402d-9b16-e60f39873353-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-a8dac98b-2e52-402d-9b16-e60f39873353-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-quobyte-a8dac98b-2e52-402d-9b16-e60f39873353" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:51 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-a8dac98b-2e52-402d-9b16-e60f39873353" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:52 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:45:52 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5cdfd2-5d09-421c-ac90-00f77fb48d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0944b7-99f5-4ec7-b5f6-414a680c6e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[879be3e1-102e-4e08-af53-39de808f4c5a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Volume volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 (9d979d1f-b76f-4381-b7dc-f1e5e514ef99): created successfully Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0944b7-99f5-4ec7-b5f6-414a680c6e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Flow 'volume_create_manager' (5df7164f-260c-4c63-a06f-566ccbac9a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fc2dbdb1-5c4d-4e89-9f02-f97b546b8db6 tempest-GroupsTest-1870933033 None] Created volume successfully. Jul 09 16:45:52 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 Jul 09 16:45:52 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:52 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Deleted volume successfully. Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e7b45071-10fe-4f23-9be5-1d312cb72ee9 tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-8b95540d-1ded-4a89-a05c-fe4d5fe2d313-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:52 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:52 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:45:52 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:52 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353" returned: 0 in 0.851s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:52 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353 Jul 09 16:45:52 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Flow 'volume_create_manager' (9493118e-f195-417a-a312-f7e31f638874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073ffe63-56e8-4e13-95a2-53b1432b510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073ffe63-56e8-4e13-95a2-53b1432b510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988578530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93c51429-f933-42c7-b9bd-36bc5ea6ad1e,host='devstack@QuobyteHD#QuobyteHD',id=89a5fe7b-909c-4260-8d3a-864ff0d27949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f735d153ab54af79d32d3f508573ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:53Z,use_quota=True,user_id='3e22c46715f84b229a15ef4d642416a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d870e9-121f-44e1-bf60-4d8be739dd2a),volume_type_id=66d870e9-121f-44e1-bf60-4d8be739dd2a)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd47ecd-9260-4453-8649-090a1c3640c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd47ecd-9260-4453-8649-090a1c3640c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26c181c-ac04-41e8-bcf0-721900dcf184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26c181c-ac04-41e8-bcf0-721900dcf184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a5fe7b-909c-4260-8d3a-864ff0d27949', 'volume_name': 'volume-89a5fe7b-909c-4260-8d3a-864ff0d27949', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d146f8-4151-4d14-b112-8ab7bad9b882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d146f8-4151-4d14-b112-8ab7bad9b882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81f658d-a05e-407a-aa44-db34cc879e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Volume 89a5fe7b-909c-4260-8d3a-864ff0d27949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a5fe7b-909c-4260-8d3a-864ff0d27949', 'volume_size': 1} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93c51429-f933-42c7-b9bd-36bc5ea6ad1e,created_at=2026-07-09T14:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988578530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93c51429-f933-42c7-b9bd-36bc5ea6ad1e,host='devstack@QuobyteHD#QuobyteHD',id=89a5fe7b-909c-4260-8d3a-864ff0d27949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f735d153ab54af79d32d3f508573ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:53Z,use_quota=True,user_id='3e22c46715f84b229a15ef4d642416a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66d870e9-121f-44e1-bf60-4d8be739dd2a),volume_type_id=66d870e9-121f-44e1-bf60-4d8be739dd2a)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Creating volume 89a5fe7b-909c-4260-8d3a-864ff0d27949 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:53 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:53 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 1073741824 Jul 09 16:45:53 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:53 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 1 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Downloaded image de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 76bd2259-884e-4a3c-afc3-ecc6fe475238 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 for user 661c5eab51e64b0992d57eddafce3794 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Marking volume 76bd2259-884e-4a3c-afc3-ecc6fe475238 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Copying metadata from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 to 76bd2259-884e-4a3c-afc3-ecc6fe475238. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Creating volume glance metadata for volume 76bd2259-884e-4a3c-afc3-ecc6fe475238 backed by image de3c03b3-c1ea-429a-9d20-5eaeb1379637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:45:53 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a8dac98b-2e52-402d-9b16-e60f39873353" returned: 0 in 0.739s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-a8dac98b-2e52-402d-9b16-e60f39873353" released by "delete_volume" :: held 1.652s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abad5487-0f24-4f65-8d64-69a91ae4982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bd2259-884e-4a3c-afc3-ecc6fe475238', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d2d3f6-ef8b-4aa4-956b-f7db40df4653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Volume volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 (76bd2259-884e-4a3c-afc3-ecc6fe475238): created successfully Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d2d3f6-ef8b-4aa4-956b-f7db40df4653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Flow 'volume_create_manager' (0cf91a8c-9c00-496f-bbd3-e3924e84101c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bfb84e63-fc53-4915-bca9-57f23c60c64f tempest-TestShelveInstance-1774774990 None] Created volume successfully. Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created reservations ['d7a912d3-25d9-4fb4-94df-3da5b70c05f3', 'f52b86b1-40f7-46cf-b1e7-15c84cc37d58', '8c658766-326a-400e-81d4-9c2e46d28554', '7f4d48ac-1649-4355-b9af-9b4a38c4e407'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:53 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:53 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:54 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 1073741824" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:54 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 Jul 09 16:45:54 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-b1bb09c4-a159-4fd3-a752-904e025aecb1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-b1bb09c4-a159-4fd3-a752-904e025aecb1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "cinder-quobyte-b1bb09c4-a159-4fd3-a752-904e025aecb1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-b1bb09c4-a159-4fd3-a752-904e025aecb1" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaade92-02a5-4b8b-8dfd-8948cb2d0093]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:54 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 Jul 09 16:45:54 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:54 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.758s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Deleted volume successfully. Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dd4f288c-866a-4a92-ac8a-a808d71257cb tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-a8dac98b-2e52-402d-9b16-e60f39873353-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:54 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81f658d-a05e-407a-aa44-db34cc879e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a5fe7b-909c-4260-8d3a-864ff0d27949', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a6e6b4-ab2a-4013-b73c-3a650e22ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Volume volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 (89a5fe7b-909c-4260-8d3a-864ff0d27949): created successfully Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a6e6b4-ab2a-4013-b73c-3a650e22ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Flow 'volume_create_manager' (9493118e-f195-417a-a312-f7e31f638874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-78bb5d21-a0ad-42ab-aef0-85d42924d325 tempest-GroupsTest-1870933033 None] Created volume successfully. Jul 09 16:45:55 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1" returned: 0 in 0.851s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:55 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1 Jul 09 16:45:55 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ce730fbb-4cfc-43c4-89f4-0cb3f19f2cbc tempest-GroupsTest-1870933033 None] Update group completed successfully. Jul 09 16:45:55 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b1bb09c4-a159-4fd3-a752-904e025aecb1" returned: 0 in 0.795s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-quobyte-b1bb09c4-a159-4fd3-a752-904e025aecb1" released by "delete_volume" :: held 1.716s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Created reservations ['2ea7283f-d2c4-4da4-ad60-610eb12f7824', '2cd95332-ef2f-4702-8ae6-deccef5618f7', 'e9bbb429-0f5b-4320-9598-bcfc654ad4f2', 'ffe43fb0-465b-462e-8286-c29460cb3fdc'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:56 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:45:56 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:56 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.656s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:45:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Deleted volume successfully. Jul 09 16:45:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9961e3dd-a286-4d84-8183-827c3ea2a33c tempest-CreateVolumesFromSourceVolumeTest-1305013297 None] Lock "cinder-b1bb09c4-a159-4fd3-a752-904e025aecb1-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:45:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-abb04f81-d476-4d94-8514-ccb31acce118 tempest-GroupsTest-1870933033 None] Update group completed successfully. Jul 09 16:45:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Acquiring lock "cinder-quobyte-89a5fe7b-909c-4260-8d3a-864ff0d27949" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:45:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Lock "cinder-quobyte-89a5fe7b-909c-4260-8d3a-864ff0d27949" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:45:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[938330a7-d772-4763-a28c-feade890e6df]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:45:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:59 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 Jul 09 16:45:59 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Flow 'volume_create_manager' (b6974c82-fe7e-439b-9504-a22626e0da3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806edf15-f961-4029-b346-3a4020632eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806edf15-f961-4029-b346-3a4020632eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1839760011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8e8395-a078-48c4-8c94-2b71e27abe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e1ceeaa2814e45b0ce3675023b485f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:59Z,use_quota=True,user_id='fb58965364ad4835a49591c299403259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0edbc4-6cb2-43bf-8fe6-b12d6796c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0edbc4-6cb2-43bf-8fe6-b12d6796c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922612ca-1b9a-447d-836b-4941eea6a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922612ca-1b9a-447d-836b-4941eea6a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a8e8395-a078-48c4-8c94-2b71e27abe30', 'volume_name': 'volume-6a8e8395-a078-48c4-8c94-2b71e27abe30', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e539c7f-eab0-4aff-a95d-c6d8cdf93705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e539c7f-eab0-4aff-a95d-c6d8cdf93705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637301e9-7d6a-4b7b-9640-324dffa319bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:45:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Volume 6a8e8395-a078-48c4-8c94-2b71e27abe30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a8e8395-a078-48c4-8c94-2b71e27abe30', 'volume_size': 1} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1839760011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a8e8395-a078-48c4-8c94-2b71e27abe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e1ceeaa2814e45b0ce3675023b485f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:45:59Z,use_quota=True,user_id='fb58965364ad4835a49591c299403259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Creating volume 6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:45:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:59 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 1073741824 Jul 09 16:45:59 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:45:59 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:45:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:45:59 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949 Jul 09 16:45:59 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:00 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 1073741824" returned: 0 in 0.973s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:00 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-89a5fe7b-909c-4260-8d3a-864ff0d27949" returned: 0 in 0.772s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:00 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 Jul 09 16:46:00 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Lock "cinder-quobyte-89a5fe7b-909c-4260-8d3a-864ff0d27949" released by "delete_volume" :: held 1.650s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Acquiring lock "cinder-quobyte-9d979d1f-b76f-4381-b7dc-f1e5e514ef99" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Lock "cinder-quobyte-9d979d1f-b76f-4381-b7dc-f1e5e514ef99" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc43f1e8-e2d2-45be-a331-8a4f3bc16be1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:00 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 Jul 09 16:46:00 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:01 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637301e9-7d6a-4b7b-9640-324dffa319bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a8e8395-a078-48c4-8c94-2b71e27abe30', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8aba29-ecb7-4db2-931b-ae1372c41833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Volume volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 (6a8e8395-a078-48c4-8c94-2b71e27abe30): created successfully Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8aba29-ecb7-4db2-931b-ae1372c41833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Flow 'volume_create_manager' (b6974c82-fe7e-439b-9504-a22626e0da3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8129be8a-4a78-4410-9a98-95431a963e72 tempest-VolumeDependencyTests-935589877 None] Created volume successfully. Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:01 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99" returned: 0 in 1.016s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036a629-462e-4ae1-95ff-effaccc56a50]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:01 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99 Jul 09 16:46:01 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:01 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:46:01 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:02 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-9d979d1f-b76f-4381-b7dc-f1e5e514ef99" returned: 0 in 0.727s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Lock "cinder-quobyte-9d979d1f-b76f-4381-b7dc-f1e5e514ef99" released by "delete_volume" :: held 1.807s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Created reservations ['d825e33a-7c49-446c-9eb2-3830c7484ebf'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:02 devstack cinder-volume[87204]: WARNING cinder.quota [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1829826128 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1829826128, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:46:02 devstack cinder-volume[87204]: WARNING cinder.quota [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1829826128 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1829826128, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:46:02 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Created reservations ['600a6bb6-4c83-4021-94ee-4a677e3ee8da', '333e2f40-78c2-4cc0-89ff-2379fac07a1c', 'fa3035b7-fa08-4b7f-acde-fb3dedc0fcad', 'f2507d84-b4f0-4efb-842e-525df213f016'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:02 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:46:02 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Created reservations ['a81968fd-9562-45ca-ad8a-61d552152a0f', '6e44eed6-7dc9-4f61-81f2-dbd98f10b21b', '45257db1-ced9-4ae9-a0ae-4d38e7dd61be', '482c1adf-7cea-43ea-9bf0-aa862a9f2329'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:02 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:46:02 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:03 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 1 in 0.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.855s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.452s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Creating offline snapshot 172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 of volume 6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb2032-8dd0-4461-9488-0c37e04b2ce4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-76bd2259-884e-4a3c-afc3-ecc6fe475238', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ca7550e-9a04-4952-962f-77250e2a99fe', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:46:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-b0582b4b-0a46-4d0b-8746-eb1d81278aa7 req-fb6b19b0-76d1-4523-a056-544ce715d0f5 tempest-TestShelveInstance-1774774990 None] attachment_update completed successfully. Jul 09 16:46:03 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 Jul 09 16:46:03 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:03 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.872s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:46:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c2026d99-f9c5-4318-bfe0-9a71d5751bd9 tempest-GroupsTest-1870933033 None] Delete group completed successfully. Jul 09 16:46:04 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30" returned: 0 in 0.919s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:04 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 1G Jul 09 16:46:04 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:05 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 1G" returned: 0 in 0.955s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:05 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 Jul 09 16:46:05 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:06 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 is being set with open permissions: ugo+rw Jul 09 16:46:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:06 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 Jul 09 16:46:06 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:06 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" returned: 0 in 0.714s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:06 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.info Jul 09 16:46:06 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:07 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.info" returned: 0 in 1.023s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:07 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.info is being set with open permissions: ugo+rw Jul 09 16:46:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:07 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.info Jul 09 16:46:07 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:08 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.info" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.250s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e5ef107f-d84b-4b9f-b8bf-e9b307313ed8 tempest-VolumeDependencyTests-935589877 None] Create snapshot completed successfully Jul 09 16:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Flow 'volume_create_manager' (8cfa963e-b634-4103-9212-17f2926d13eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919ce550-3c1e-4d46-8f4a-08dfb09f4e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919ce550-3c1e-4d46-8f4a-08dfb09f4e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1109781565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd1b1ef-3396-43cd-9549-57f22671e399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e1ceeaa2814e45b0ce3675023b485f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=172041dc-2375-4f89-a8ae-b6f8c6f3e9a2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:46:10Z,use_quota=True,user_id='fb58965364ad4835a49591c299403259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25666bd7-4e9d-4cef-adac-65af9120cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25666bd7-4e9d-4cef-adac-65af9120cce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9b039e-c145-4315-bea8-cabba415ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9b039e-c145-4315-bea8-cabba415ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfd1b1ef-3396-43cd-9549-57f22671e399', 'volume_name': 'volume-bfd1b1ef-3396-43cd-9549-57f22671e399', 'volume_size': 1, 'snapshot_id': '172041dc-2375-4f89-a8ae-b6f8c6f3e9a2'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ea0243-e1ec-4e79-80d2-78a4966e6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ea0243-e1ec-4e79-80d2-78a4966e6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4320aac8-7fb4-4c54-b801-3d3e917a549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Volume bfd1b1ef-3396-43cd-9549-57f22671e399: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfd1b1ef-3396-43cd-9549-57f22671e399', 'volume_size': 1, 'snapshot_id': '172041dc-2375-4f89-a8ae-b6f8c6f3e9a2'} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-quobyte-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2-bfd1b1ef-3396-43cd-9549-57f22671e399" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2-bfd1b1ef-3396-43cd-9549-57f22671e399" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Creating volume bfd1b1ef-3396-43cd-9549-57f22671e399 from snapshot 172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-quobyte-bfd1b1ef-3396-43cd-9549-57f22671e399" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-bfd1b1ef-3396-43cd-9549-57f22671e399" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] snapshot: 172041dc-2375-4f89-a8ae-b6f8c6f3e9a2, volume: bfd1b1ef-3396-43cd-9549-57f22671e399, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a69d0-6e75-43ba-a9b7-07195b530ac6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:10 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 Jul 09 16:46:10 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:11 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" returned: 0 in 1.150s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a8e8395-a078-48c4-8c94-2b71e27abe30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:46:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:46:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14a433-3233-4737-9fe1-8668a4a756ff]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:11 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 Jul 09 16:46:11 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:12 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30" returned: 0 in 1.099s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:12 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:46:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:12 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 Jul 09 16:46:12 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:19 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399" returned: 0 in 7.431s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8033b2-ed48-4b26-a7ef-bea334d82bf5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:20 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 Jul 09 16:46:20 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:20 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=86,cinder:DELETE=6,cinder:INSERT=21,cinder:UPDATE=84 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:46:20 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=74,cinder:UPDATE=97,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:46:21 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30" returned: 0 in 1.148s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:46:21 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Converted 1024.00 MB image at 137.78 MB/s Jul 09 16:46:21 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 is being set with open permissions: ugo+rw Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:21 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 Jul 09 16:46:21 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Flow 'volume_create_manager' (c33cb996-e52a-4113-9ca5-237d4537c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ef7055-e6d6-4db4-acb9-d0299e7b32bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ef7055-e6d6-4db4-acb9-d0299e7b32bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-967194373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185f57fb-a78d-40ce-a744-477827f70ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e789d65395eb414ca2a9e9bc746d4e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:46:22Z,use_quota=True,user_id='3bbac41395d24cd2b9b6232a9cae765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbbe34ea-e050-4e51-a1c9-228e5e93fae8),volume_type_id=bbbe34ea-e050-4e51-a1c9-228e5e93fae8)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8db1e21-76c4-414f-a60e-2db37c7ef33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8db1e21-76c4-414f-a60e-2db37c7ef33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa414cd-06f3-476e-9bdd-0db462f330e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa414cd-06f3-476e-9bdd-0db462f330e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185f57fb-a78d-40ce-a744-477827f70ac1', 'volume_name': 'volume-185f57fb-a78d-40ce-a744-477827f70ac1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4944372b-2c61-4441-b188-4224ca6de553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4944372b-2c61-4441-b188-4224ca6de553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71206d48-ce64-4453-9e06-29c899644a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Volume 185f57fb-a78d-40ce-a744-477827f70ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185f57fb-a78d-40ce-a744-477827f70ac1', 'volume_size': 1} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:21 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-bfd1b1ef-3396-43cd-9549-57f22671e399" released by "_copy_volume_from_snapshot" :: held 11.737s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2-bfd1b1ef-3396-43cd-9549-57f22671e399" released by "_create_volume_from_snapshot" :: held 11.776s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.797s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-967194373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185f57fb-a78d-40ce-a744-477827f70ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e789d65395eb414ca2a9e9bc746d4e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:46:22Z,use_quota=True,user_id='3bbac41395d24cd2b9b6232a9cae765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbbe34ea-e050-4e51-a1c9-228e5e93fae8),volume_type_id=bbbe34ea-e050-4e51-a1c9-228e5e93fae8)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Creating volume 185f57fb-a78d-40ce-a744-477827f70ac1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:46:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:21 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 1073741824 Jul 09 16:46:21 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4320aac8-7fb4-4c54-b801-3d3e917a549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd1b1ef-3396-43cd-9549-57f22671e399', 'volume_size': 1, 'snapshot_id': '172041dc-2375-4f89-a8ae-b6f8c6f3e9a2'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80595f24-a910-482d-951e-84203f01cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Volume volume-bfd1b1ef-3396-43cd-9549-57f22671e399 (bfd1b1ef-3396-43cd-9549-57f22671e399): created successfully Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80595f24-a910-482d-951e-84203f01cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Flow 'volume_create_manager' (8cfa963e-b634-4103-9212-17f2926d13eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-97d9299f-44db-4e67-807c-9ccb1b73fda5 tempest-VolumeDependencyTests-935589877 None] Created volume successfully. Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-quobyte-6a8e8395-a078-48c4-8c94-2b71e27abe30" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-6a8e8395-a078-48c4-8c94-2b71e27abe30" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-quobyte-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Deleting offline snapshot 172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 of volume 6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] snapshot_file for this snap is: volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c6e311-21b6-43ae-ba71-3562b893b828]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:22 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 1073741824" returned: 0 in 0.919s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:22 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 Jul 09 16:46:22 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:22 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 Jul 09 16:46:22 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:23 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:23 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a8e8395-a078-48c4-8c94-2b71e27abe30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71206d48-ce64-4453-9e06-29c899644a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185f57fb-a78d-40ce-a744-477827f70ac1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c23e9d4-95c6-4301-8129-92de53bd8bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b048cb-21a1-410b-899d-5e9ee8d74843]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Volume volume-185f57fb-a78d-40ce-a744-477827f70ac1 (185f57fb-a78d-40ce-a744-477827f70ac1): created successfully Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c23e9d4-95c6-4301-8129-92de53bd8bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Flow 'volume_create_manager' (c33cb996-e52a-4113-9ca5-237d4537c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3db04691-b014-4ee9-9674-9248061a532f tempest-VolumeTypesAccessTest-1673040335 None] Created volume successfully. Jul 09 16:46:23 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 Jul 09 16:46:23 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:24 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:24 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 Jul 09 16:46:24 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Acquiring lock "cinder-185f57fb-a78d-40ce-a744-477827f70ac1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Lock "cinder-185f57fb-a78d-40ce-a744-477827f70ac1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Acquiring lock "cinder-quobyte-185f57fb-a78d-40ce-a744-477827f70ac1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Lock "cinder-quobyte-185f57fb-a78d-40ce-a744-477827f70ac1" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c8ed6c-26fa-47d5-9011-fe2813981558]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:25 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 Jul 09 16:46:25 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:25 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:25 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2 Jul 09 16:46:25 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:25 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1" returned: 0 in 0.775s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:25 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1 Jul 09 16:46:25 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:25 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30.172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" returned: 0 in 0.662s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2" released by "_delete_snapshot" :: held 3.145s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-6a8e8395-a078-48c4-8c94-2b71e27abe30" released by "delete_snapshot" :: held 3.170s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Created reservations ['fd04fef8-1e2f-4c02-baba-0354888820a9', 'c14cf0b7-0ca1-42a9-9b27-64fabe987537', '753586d7-ed9c-43e1-b10f-cb05f3fc24ed', '7863f1db-a619-43eb-89a7-e7bc95300012'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Delete snapshot completed successfully. Jul 09 16:46:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-81611c17-c4a4-4bdf-8003-62c360217656 tempest-VolumeDependencyTests-935589877 None] Lock "cinder-172041dc-2375-4f89-a8ae-b6f8c6f3e9a2-delete_snapshot" released by "delete_snapshot" :: held 3.352s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:26 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-185f57fb-a78d-40ce-a744-477827f70ac1" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Lock "cinder-quobyte-185f57fb-a78d-40ce-a744-477827f70ac1" released by "delete_volume" :: held 1.566s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:26 devstack cinder-volume[87204]: WARNING cinder.quota [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1392785565 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1392785565, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:46:26 devstack cinder-volume[87204]: WARNING cinder.quota [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1392785565 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1392785565, it is now deprecated. Please use the default quota class for default quota. Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Created reservations ['d3780d7b-d703-4728-9050-d314939e2c6f', 'a71e1b1b-da80-4108-ad7c-30694148790d', '75dc2df8-8f0b-4494-8830-f07a57c177b5', '18ad5bee-890e-435a-9758-b6659311ebe7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:26 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:46:26 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-6a8e8395-a078-48c4-8c94-2b71e27abe30-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Lock "cinder-6a8e8395-a078-48c4-8c94-2b71e27abe30-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-quobyte-6a8e8395-a078-48c4-8c94-2b71e27abe30" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-6a8e8395-a078-48c4-8c94-2b71e27abe30" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee8cef1-5b9e-4afe-a167-4d4c6ba6a2df]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:27 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 Jul 09 16:46:27 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:27 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:27 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:46:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Deleted volume successfully. Jul 09 16:46:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-93b72232-e520-48d0-92c7-d261c696bee2 tempest-VolumeTypesAccessTest-1673040335 None] Lock "cinder-185f57fb-a78d-40ce-a744-477827f70ac1-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:27 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30" returned: 0 in 0.927s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:28 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30 Jul 09 16:46:28 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:28 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-6a8e8395-a078-48c4-8c94-2b71e27abe30" returned: 0 in 0.687s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-6a8e8395-a078-48c4-8c94-2b71e27abe30" released by "delete_volume" :: held 1.721s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Created reservations ['627e5e49-f3d1-4b6f-a7fb-493a61389757', '5249db75-e4b7-4097-8f76-f5acc0fd04ee', '552df454-c381-43c9-9f05-ac1d289dcb40', 'f8019554-ab64-491c-9ca5-7eac59fa8f29'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:28 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:46:28 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:28 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:46:28 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-bfd1b1ef-3396-43cd-9549-57f22671e399-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Lock "cinder-bfd1b1ef-3396-43cd-9549-57f22671e399-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Acquiring lock "cinder-quobyte-bfd1b1ef-3396-43cd-9549-57f22671e399" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-bfd1b1ef-3396-43cd-9549-57f22671e399" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ad650-dd97-4182-9d97-496f83d775e0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:29 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 Jul 09 16:46:29 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:29 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.863s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:46:29 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:46:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Deleted volume successfully. Jul 09 16:46:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-fd64b712-8330-4d18-a579-1bd8d06bddda tempest-VolumeDependencyTests-935589877 None] Lock "cinder-6a8e8395-a078-48c4-8c94-2b71e27abe30-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:30 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399" returned: 0 in 0.844s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:30 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399 Jul 09 16:46:30 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:30 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-bfd1b1ef-3396-43cd-9549-57f22671e399" returned: 0 in 0.667s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Lock "cinder-quobyte-bfd1b1ef-3396-43cd-9549-57f22671e399" released by "delete_volume" :: held 1.574s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:30 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Created reservations ['83193129-7e7a-4b2c-9e79-8d40d9fc4ba3', '61193405-ac49-495e-8829-7294bc6b19a9', 'f556622b-f2de-4ef9-b200-95f988f33ba5', '01a27f3c-161b-4a15-b2fe-7aed0f25399c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:31 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:46:31 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:31 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:46:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Deleted volume successfully. Jul 09 16:46:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-854b20e4-f746-439f-b2e5-6f0bb9456d5e tempest-VolumeDependencyTests-935589877 None] Lock "cinder-bfd1b1ef-3396-43cd-9549-57f22671e399-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:41 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=23,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:46:41 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=36,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:46:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-056a52d0-0637-48a7-9a77-a0b09b2ca0a0 req-5d41bddd-7f51-41c5-ae3a-d6b040f955c4 tempest-TestShelveInstance-1774774990 None] Terminate volume connection completed successfully. Jul 09 16:46:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-056a52d0-0637-48a7-9a77-a0b09b2ca0a0 req-5d41bddd-7f51-41c5-ae3a-d6b040f955c4 tempest-TestShelveInstance-1774774990 None] Deleting attachment 5ca7550e-9a04-4952-962f-77250e2a99fe. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:46:49 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Flow 'volume_create_manager' (25f494ad-fe0a-432f-a6c8-dc550f76312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d240e2e0-f27a-4ea6-9802-521b5da38a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d240e2e0-f27a-4ea6-9802-521b5da38a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1391459840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb76f72-0f30-478e-9345-feeb0f64bbb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33386973310f4d97ae2e97501b380a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:46:50Z,use_quota=True,user_id='1255a86e1ffc4d3f803d4634a1061a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b76b6f5-e3ee-4fae-92c9-7408a1db22d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b76b6f5-e3ee-4fae-92c9-7408a1db22d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f2e82-f031-449f-980c-7207a3e24ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f2e82-f031-449f-980c-7207a3e24ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb76f72-0f30-478e-9345-feeb0f64bbb4', 'volume_name': 'volume-feb76f72-0f30-478e-9345-feeb0f64bbb4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd6b038-cfe2-4da1-beec-c53344cfeb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd6b038-cfe2-4da1-beec-c53344cfeb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc7cfc3-d20b-41a8-ae13-c7de4fdfaf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Volume feb76f72-0f30-478e-9345-feeb0f64bbb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb76f72-0f30-478e-9345-feeb0f64bbb4', 'volume_size': 1} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1391459840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb76f72-0f30-478e-9345-feeb0f64bbb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33386973310f4d97ae2e97501b380a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:46:50Z,use_quota=True,user_id='1255a86e1ffc4d3f803d4634a1061a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Creating volume feb76f72-0f30-478e-9345-feeb0f64bbb4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:46:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:46:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:50 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 1073741824 Jul 09 16:46:50 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:51 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 1073741824" returned: 0 in 0.990s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:51 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 Jul 09 16:46:51 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:51 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc7cfc3-d20b-41a8-ae13-c7de4fdfaf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb76f72-0f30-478e-9345-feeb0f64bbb4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1d30bb-e253-4d10-8136-4a85f5e24f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Volume volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 (feb76f72-0f30-478e-9345-feeb0f64bbb4): created successfully Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1d30bb-e253-4d10-8136-4a85f5e24f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Flow 'volume_create_manager' (25f494ad-fe0a-432f-a6c8-dc550f76312f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4c92ebe9-9fd7-4ecb-b137-1e12f4070d89 tempest-VolumesTransfersV355Test-1563686959 None] Created volume successfully. Jul 09 16:46:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0bd626-343c-4de4-be09-e99eda55f43f]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:52 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:46:52 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-91862819-376e-43c0-953e-03375a159f27 tempest-VolumesTransfersV355Test-1371929923 None] Transfer volume completed successfully. Jul 09 16:46:53 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 0 in 0.844s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:53 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:46:53 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:54 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 1 in 0.878s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.804s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Acquiring lock "cinder-feb76f72-0f30-478e-9345-feeb0f64bbb4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-76bd2259-884e-4a3c-afc3-ecc6fe475238', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a92a24ab-3e57-4bd5-ae15-2706e47ff0e2', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-feb76f72-0f30-478e-9345-feeb0f64bbb4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Acquiring lock "cinder-quobyte-feb76f72-0f30-478e-9345-feeb0f64bbb4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-quobyte-feb76f72-0f30-478e-9345-feeb0f64bbb4" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:46:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-e1765894-73ba-4c8f-afb0-76d566e7f48f req-7e71b846-1dfa-4d4c-b4fc-63b34d867435 tempest-TestShelveInstance-1774774990 None] attachment_update completed successfully. Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[850a9ff6-35da-4453-9825-5b095f604adb]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:46:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:54 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 Jul 09 16:46:54 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:55 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:55 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4 Jul 09 16:46:55 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:55 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-feb76f72-0f30-478e-9345-feeb0f64bbb4" returned: 0 in 0.639s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-quobyte-feb76f72-0f30-478e-9345-feeb0f64bbb4" released by "delete_volume" :: held 1.511s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Created reservations ['ffb1a99d-999f-4dcc-bc6b-2a1e7368cfd3', '8d817b23-624c-48d7-a7dc-c3eb7d1c8b43', '76f6aa32-1eec-4613-80fa-0aa8cc9c9d40', '8c3aa648-1066-4a3c-be96-1c5b76e1f9b6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:55 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:46:55 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:56 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.757s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:56 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:46:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Deleted volume successfully. Jul 09 16:46:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-22df3c52-e25c-4c2f-b0d0-7c4e328c958d tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-feb76f72-0f30-478e-9345-feeb0f64bbb4-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:46:56 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:46:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Flow 'volume_create_manager' (58c8b4d7-37f1-4549-a930-0d14473f14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b82f1-cc4d-4bee-8263-44e9e21ca817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10b82f1-cc4d-4bee-8263-44e9e21ca817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1797236736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae35f9-53d1-4d32-8d28-56fc8d69c2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33386973310f4d97ae2e97501b380a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:46:57Z,use_quota=True,user_id='1255a86e1ffc4d3f803d4634a1061a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19ed213-6ed8-455a-a6da-9982996ac69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19ed213-6ed8-455a-a6da-9982996ac69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b4a57-c3be-419e-aa8c-1625fa0d8973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b4a57-c3be-419e-aa8c-1625fa0d8973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ae35f9-53d1-4d32-8d28-56fc8d69c2d8', 'volume_name': 'volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f60525-56da-4d11-b412-27fce9020ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f60525-56da-4d11-b412-27fce9020ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dff82cf-a4c0-42b3-91fd-41ab988913f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:57 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Volume 15ae35f9-53d1-4d32-8d28-56fc8d69c2d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8', 'volume_size': 1} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1797236736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae35f9-53d1-4d32-8d28-56fc8d69c2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33386973310f4d97ae2e97501b380a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:46:57Z,use_quota=True,user_id='1255a86e1ffc4d3f803d4634a1061a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Creating volume 15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:46:57 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:46:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:57 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 1073741824 Jul 09 16:46:57 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:58 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 1073741824" returned: 0 in 1.026s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:46:58 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 Jul 09 16:46:58 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:46:58 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 09 16:46:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8" returned: 0 in 0.793s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:46:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:46:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:46:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dff82cf-a4c0-42b3-91fd-41ab988913f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb772297-3581-4dff-a058-57cdb13b8c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:46:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Volume volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 (15ae35f9-53d1-4d32-8d28-56fc8d69c2d8): created successfully Jul 09 16:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb772297-3581-4dff-a058-57cdb13b8c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:46:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Flow 'volume_create_manager' (58c8b4d7-37f1-4549-a930-0d14473f14ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:46:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-250d769d-2ad0-4712-b5c5-4ea41ee20699 tempest-VolumesTransfersV355Test-1563686959 None] Created volume successfully. Jul 09 16:47:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Acquiring lock "cinder-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Acquiring lock "cinder-quobyte-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-quobyte-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[70edab4e-0665-405b-811c-f346e82d6a2e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:00 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 Jul 09 16:47:00 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:01 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:01 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8 Jul 09 16:47:01 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:02 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-quobyte-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8" released by "delete_volume" :: held 1.706s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Created reservations ['2dd3b3a0-1da8-4ba1-a49e-5340ba05ac41', 'dd089a2b-cb50-4207-810d-6def749804a5', '37b8ab53-8749-45b2-ab68-57c4d73da2e2', '9fb3c1ad-4f64-4394-96be-7eb756eb1d86'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Flow 'volume_create_manager' (31112666-229a-4899-91c1-23033da1c50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912e0501-0ed7-4025-915b-8448c455abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912e0501-0ed7-4025-915b-8448c455abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-943297449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f18d567-91c5-4444-b427-e5710d81f9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6bc04ba87e4139bde76df6a48aa27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:02Z,use_quota=True,user_id='cb38c3befa424952b068ff51adc082b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:02 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861a6e6c-6479-4a0c-a95b-9cda137d743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:02 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861a6e6c-6479-4a0c-a95b-9cda137d743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd72eafa-f060-4b25-a82a-763edfbd227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd72eafa-f060-4b25-a82a-763edfbd227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f18d567-91c5-4444-b427-e5710d81f9de', 'volume_name': 'volume-5f18d567-91c5-4444-b427-e5710d81f9de', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320f4d4c-64ae-4311-8907-7529dc4838ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320f4d4c-64ae-4311-8907-7529dc4838ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d97e8ed-b8fb-46df-a8e5-1ff851893248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Volume 5f18d567-91c5-4444-b427-e5710d81f9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f18d567-91c5-4444-b427-e5710d81f9de', 'volume_size': 1} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-943297449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f18d567-91c5-4444-b427-e5710d81f9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6bc04ba87e4139bde76df6a48aa27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:02Z,use_quota=True,user_id='cb38c3befa424952b068ff51adc082b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Creating volume 5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:47:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:47:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:02 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de 1073741824 Jul 09 16:47:02 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:03 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.697s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:03 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Deleted volume successfully. Jul 09 16:47:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e861157-0c93-4af0-9041-810dc4d10b36 tempest-VolumesTransfersV355Test-665557951 None] Lock "cinder-15ae35f9-53d1-4d32-8d28-56fc8d69c2d8-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:03 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de 1073741824" returned: 0 in 1.015s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:03 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de Jul 09 16:47:03 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:04 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de" returned: 0 in 0.641s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:47:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d97e8ed-b8fb-46df-a8e5-1ff851893248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f18d567-91c5-4444-b427-e5710d81f9de', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5b8284-d718-4154-87a6-a848e95ae93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Volume volume-5f18d567-91c5-4444-b427-e5710d81f9de (5f18d567-91c5-4444-b427-e5710d81f9de): created successfully Jul 09 16:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5b8284-d718-4154-87a6-a848e95ae93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Flow 'volume_create_manager' (31112666-229a-4899-91c1-23033da1c50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-01262947-702b-4c74-9d49-e8a295950047 tempest-SnapshotDependencyTests-628861988 None] Created volume successfully. Jul 09 16:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Creating offline snapshot 18f15027-bd6f-48f6-a181-c72d81c70748 of volume 5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:47:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d276eaa-c563-445a-9bfc-e9a54daed995]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:05 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de Jul 09 16:47:05 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:05 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:05 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 1G Jul 09 16:47:05 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:06 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 1G" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f18d567-91c5-4444-b427-e5710d81f9de -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:06 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f18d567-91c5-4444-b427-e5710d81f9de -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 Jul 09 16:47:06 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:07 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f18d567-91c5-4444-b427-e5710d81f9de -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748" returned: 0 in 0.945s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:07 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 is being set with open permissions: ugo+rw Jul 09 16:47:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:07 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 Jul 09 16:47:07 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:08 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:08 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.info Jul 09 16:47:08 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:47:09 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Flow 'volume_create_manager' (7d9b725e-8c9f-45f8-8ecc-fac13a1a414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebc4c58-45eb-44d5-977a-a785ac79e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.info" returned: 0 in 0.868s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:09 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.info is being set with open permissions: ugo+rw Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:09 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.info Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebc4c58-45eb-44d5-977a-a785ac79e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-317753598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401413c7-0c86-47f4-a182-cdb501b927d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b192c556c34b8998a7e44ec909f135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:10Z,use_quota=True,user_id='452363f3e0f249f5b6e145402c837626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:09 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925cbeee-a6ac-4843-8866-e624411edfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925cbeee-a6ac-4843-8866-e624411edfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6571545a-4a41-4c12-b1e8-bdcd0a61404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6571545a-4a41-4c12-b1e8-bdcd0a61404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '401413c7-0c86-47f4-a182-cdb501b927d5', 'volume_name': 'volume-401413c7-0c86-47f4-a182-cdb501b927d5', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b678b90e-036c-4d99-a6ec-e5f9439ae546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b678b90e-036c-4d99-a6ec-e5f9439ae546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f00ad3-4b97-44a6-a1fb-d942bb30835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Volume 401413c7-0c86-47f4-a182-cdb501b927d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-401413c7-0c86-47f4-a182-cdb501b927d5', 'volume_size': 2} Jul 09 16:47:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:10 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.info" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.273s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-317753598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401413c7-0c86-47f4-a182-cdb501b927d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1b192c556c34b8998a7e44ec909f135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:10Z,use_quota=True,user_id='452363f3e0f249f5b6e145402c837626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Creating volume 401413c7-0c86-47f4-a182-cdb501b927d5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:47:10 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:47:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 2147483648 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:10 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 2147483648 Jul 09 16:47:10 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3d9971ab-8354-4afc-8c37-68916427371a tempest-SnapshotDependencyTests-628861988 None] Create snapshot completed successfully Jul 09 16:47:11 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 2147483648" returned: 0 in 0.896s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:11 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 Jul 09 16:47:11 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:12 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f00ad3-4b97-44a6-a1fb-d942bb30835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401413c7-0c86-47f4-a182-cdb501b927d5', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81916ae5-3908-4813-a89a-ecac858f441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Volume volume-401413c7-0c86-47f4-a182-cdb501b927d5 (401413c7-0c86-47f4-a182-cdb501b927d5): created successfully Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81916ae5-3908-4813-a89a-ecac858f441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Flow 'volume_create_manager' (7d9b725e-8c9f-45f8-8ecc-fac13a1a414f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:47:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e5a03fa8-dbf0-4d59-ad6b-fdc1e37d1253 tempest-VolumesCloneNegativeTest-854387499 None] Created volume successfully. Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Flow 'volume_create_manager' (172b88c5-ef38-4da4-b19a-a50a20a2360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712e0702-70df-471c-9682-8a941524a99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712e0702-70df-471c-9682-8a941524a99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ad9f7b-61b5-4a25-b50e-6ac2140f754c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6bc04ba87e4139bde76df6a48aa27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=18f15027-bd6f-48f6-a181-c72d81c70748,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:12Z,use_quota=True,user_id='cb38c3befa424952b068ff51adc082b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367efa2b-5374-469c-b4dc-ae5621075de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367efa2b-5374-469c-b4dc-ae5621075de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f8c435-89fe-430f-97e2-0ee62a2c7296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f8c435-89fe-430f-97e2-0ee62a2c7296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4ad9f7b-61b5-4a25-b50e-6ac2140f754c', 'volume_name': 'volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c', 'volume_size': 1, 'snapshot_id': '18f15027-bd6f-48f6-a181-c72d81c70748'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a04cfee-28a2-4579-aeab-9bed9940d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a04cfee-28a2-4579-aeab-9bed9940d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c4676a-78e6-459b-bda8-bb00270463db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Volume d4ad9f7b-61b5-4a25-b50e-6ac2140f754c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c', 'volume_size': 1, 'snapshot_id': '18f15027-bd6f-48f6-a181-c72d81c70748'} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-quobyte-18f15027-bd6f-48f6-a181-c72d81c70748-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-18f15027-bd6f-48f6-a181-c72d81c70748-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Creating volume d4ad9f7b-61b5-4a25-b50e-6ac2140f754c from snapshot 18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-quobyte-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] snapshot: 18f15027-bd6f-48f6-a181-c72d81c70748, volume: d4ad9f7b-61b5-4a25-b50e-6ac2140f754c, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d905db-9b6d-4013-9fd7-fbf3b9614f0a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:12 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 Jul 09 16:47:12 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Acquiring lock "cinder-401413c7-0c86-47f4-a182-cdb501b927d5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Lock "cinder-401413c7-0c86-47f4-a182-cdb501b927d5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Acquiring lock "cinder-quobyte-401413c7-0c86-47f4-a182-cdb501b927d5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Lock "cinder-quobyte-401413c7-0c86-47f4-a182-cdb501b927d5" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[74caa345-532e-417f-9b87-912c72c73e71]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:13 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 Jul 09 16:47:13 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:13 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f18d567-91c5-4444-b427-e5710d81f9de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[40390775-3f6e-488e-a315-16d14c24ec57]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:13 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de Jul 09 16:47:13 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:13 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5" returned: 0 in 0.752s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:13 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5 Jul 09 16:47:13 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:13 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de" returned: 0 in 0.789s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:47:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:14 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c Jul 09 16:47:14 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:14 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-401413c7-0c86-47f4-a182-cdb501b927d5" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Lock "cinder-quobyte-401413c7-0c86-47f4-a182-cdb501b927d5" released by "delete_volume" :: held 1.501s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Created reservations ['862e36e6-1182-4ba1-849b-c205136308c3', 'a9a0a26f-1fb6-47c1-977c-909a8ead2352', '98803478-ae8a-4f42-bbd7-4b57b343f346', '13e1ed6a-3296-442a-a918-faf08db5673a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:14 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:14 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:16 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.591s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:16 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Deleted volume successfully. Jul 09 16:47:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95c1f740-2616-4b6a-ab35-f847e2ec7ce0 tempest-VolumesCloneNegativeTest-854387499 None] Lock "cinder-401413c7-0c86-47f4-a182-cdb501b927d5-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:19 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" returned: 0 in 5.981s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d132a414-05d6-4599-acb0-cd782de88927]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:20 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de Jul 09 16:47:20 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:20 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de" returned: 0 in 0.992s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:20 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:47:20 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Converted 1024.00 MB image at 171.19 MB/s Jul 09 16:47:20 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c is being set with open permissions: ugo+rw Jul 09 16:47:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:21 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c Jul 09 16:47:21 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:21 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" released by "_copy_volume_from_snapshot" :: held 9.461s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-18f15027-bd6f-48f6-a181-c72d81c70748-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" released by "_create_volume_from_snapshot" :: held 9.496s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.514s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c4676a-78e6-459b-bda8-bb00270463db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c', 'volume_size': 1, 'snapshot_id': '18f15027-bd6f-48f6-a181-c72d81c70748'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca619d1f-d99d-4254-8ee6-8213ac305f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Flow 'volume_create_manager' (9ed082bb-c3f9-4ba7-88e8-f3bd7bef52d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67460dc4-2b76-4d7a-925a-34017e573388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Volume volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c (d4ad9f7b-61b5-4a25-b50e-6ac2140f754c): created successfully Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca619d1f-d99d-4254-8ee6-8213ac305f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Flow 'volume_create_manager' (172b88c5-ef38-4da4-b19a-a50a20a2360f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67460dc4-2b76-4d7a-925a-34017e573388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-11502679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deb1387-be0d-412c-aeda-25dab1073e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81c3fa9c2f74c0e93a0400c2c703fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:22Z,use_quota=True,user_id='382b02e3126249dd891ea775c38ccd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66f31d-af39-4fac-9ed5-14a1835764a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66f31d-af39-4fac-9ed5-14a1835764a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e36324-83ec-4d73-bf22-8afe4ff31803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:21 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:47:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3b62932f-2a62-4af6-936b-8c0b81775f62 tempest-SnapshotDependencyTests-628861988 None] Created volume successfully. Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-18f15027-bd6f-48f6-a181-c72d81c70748-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e36324-83ec-4d73-bf22-8afe4ff31803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0deb1387-be0d-412c-aeda-25dab1073e66', 'volume_name': 'volume-0deb1387-be0d-412c-aeda-25dab1073e66', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbcd9d5-fe76-417f-be18-3525bf22e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbcd9d5-fe76-417f-be18-3525bf22e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46b6edf-186a-4ec4-8812-e1a1de1a21e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:22 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Volume 0deb1387-be0d-412c-aeda-25dab1073e66: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0deb1387-be0d-412c-aeda-25dab1073e66', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Trying to clone 0deb1387-be0d-412c-aeda-25dab1073e66 from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-18f15027-bd6f-48f6-a181-c72d81c70748-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-quobyte-5f18d567-91c5-4444-b427-e5710d81f9de" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-5f18d567-91c5-4444-b427-e5710d81f9de" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-quobyte-18f15027-bd6f-48f6-a181-c72d81c70748" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-18f15027-bd6f-48f6-a181-c72d81c70748" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Deleting offline snapshot 18f15027-bd6f-48f6-a181-c72d81c70748 of volume 5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] snapshot_file for this snap is: volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea635413-37c7-4715-958e-7e172645ed00]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:22 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 Jul 09 16:47:22 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:47:22 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Image download 20.69 MB at 20.69 MB/s Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63db5d4-d0ae-4dd3-a98f-e7a425517812]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:22 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD Jul 09 16:47:22 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:23 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f18d567-91c5-4444-b427-e5710d81f9de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aff2a8-2373-4c3b-8cae-56b35be06b7f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:23 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de Jul 09 16:47:23 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:23 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 is fetched for user 382b02e3126249dd891ea775c38ccd7d. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffad16f-935c-40e7-a78c-5d017df7a981]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:23 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD Jul 09 16:47:23 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:24 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de" returned: 0 in 0.794s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:24 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 Jul 09 16:47:24 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:24 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-11502679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0deb1387-be0d-412c-aeda-25dab1073e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81c3fa9c2f74c0e93a0400c2c703fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:22Z,use_quota=True,user_id='382b02e3126249dd891ea775c38ccd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Creating volume 0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:47:24 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:24 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 1073741824 Jul 09 16:47:24 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:24 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748" returned: 0 in 0.749s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:24 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748 Jul 09 16:47:24 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:25 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 1073741824" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:25 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:25 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:25 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de.18f15027-bd6f-48f6-a181-c72d81c70748" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-18f15027-bd6f-48f6-a181-c72d81c70748" released by "_delete_snapshot" :: held 3.151s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-5f18d567-91c5-4444-b427-e5710d81f9de" released by "delete_snapshot" :: held 3.177s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:25 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Created reservations ['11ad13b5-31b4-4ada-8e0c-a41c6ed7f3d8', 'a2d345f1-8d72-4309-bbbb-f3c847d30237', '8b8e423e-056a-4c83-9b61-b4c2edf19abe', '9b57e2c7-3995-4225-a196-9fc1063d053e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Delete snapshot completed successfully. Jul 09 16:47:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1e6f3d0a-b933-4eee-9bf3-12776d609d08 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-18f15027-bd6f-48f6-a181-c72d81c70748-delete_snapshot" released by "delete_snapshot" :: held 3.305s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:26 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 0 in 0.645s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Attempting download of de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 0deb1387-be0d-412c-aeda-25dab1073e66. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a638d-ad57-406e-8b34-e53cc034361d]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_71b0l5vz {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:26 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_71b0l5vz Jul 09 16:47:26 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-5f18d567-91c5-4444-b427-e5710d81f9de-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-5f18d567-91c5-4444-b427-e5710d81f9de-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-quobyte-5f18d567-91c5-4444-b427-e5710d81f9de" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-5f18d567-91c5-4444-b427-e5710d81f9de" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e5b931-fccd-46d8-93dc-ec6510f324d0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:26 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de Jul 09 16:47:26 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:26 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_71b0l5vz" returned: 0 in 0.730s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_71b0l5vz {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:26 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_71b0l5vz Jul 09 16:47:26 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:27 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de" returned: 0 in 0.761s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:27 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de Jul 09 16:47:27 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:27 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_71b0l5vz" returned: 1 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_71b0l5vz' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:47:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3ce424-0f40-4782-b8f1-0c55896c35c9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:27 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD Jul 09 16:47:27 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:28 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-5f18d567-91c5-4444-b427-e5710d81f9de" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-5f18d567-91c5-4444-b427-e5710d81f9de" released by "delete_volume" :: held 1.477s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Created reservations ['542a1aa8-c702-46e6-94f4-1d1a4c26feb4', '2b5546dc-5dae-4e26-80b9-a1a266df4b0e', '33260f25-35f0-4192-bc26-a12bfb7cf9ec', '25379336-2eb3-48b0-9cf9-5ebc9eecd961'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:28 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:28 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:28 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] de3c03b3-c1ea-429a-9d20-5eaeb1379637 was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:28 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:28 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:28 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.665s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:28 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:28 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Deleted volume successfully. Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eda39ba1-499c-4f64-b2b2-a7c6b6aea461 tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-5f18d567-91c5-4444-b427-e5710d81f9de-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "cinder-quobyte-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c30a7e-b9d3-4326-9b23-889149959c25]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:29 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c Jul 09 16:47:29 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:29 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.744s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:47:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:47:29 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:29 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c Jul 09 16:47:29 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:30 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 0 in 1.917s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_4nu5e8vndevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:47:30 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Converted 112.00 MB image at 58.39 MB/s Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:30 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 1G Jul 09 16:47:30 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:30 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-quobyte-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c" released by "delete_volume" :: held 1.535s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Created reservations ['c9529ec4-fff4-4240-9932-bf149d3ab6e2', 'f3ca90aa-1b49-4141-a858-cd82010f9d44', '34573227-236f-4471-aca4-c5e0a74091de', 'fc6163ee-2408-4e6e-9402-67ae35419825'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:30 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:30 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:31 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 1G" returned: 0 in 0.820s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc9c1ed-ebf6-44a9-adcd-332a17b9f75c]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:31 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:31 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:31 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:31 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Deleted volume successfully. Jul 09 16:47:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9e7887a1-25d4-4718-9fab-c280672a9fbf tempest-SnapshotDependencyTests-628861988 None] Lock "cinder-d4ad9f7b-61b5-4a25-b50e-6ac2140f754c-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:32 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 0 in 0.954s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:32 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:32 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:32 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 1 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Downloaded image de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 0deb1387-be0d-412c-aeda-25dab1073e66 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 for user 382b02e3126249dd891ea775c38ccd7d is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Marking volume 0deb1387-be0d-412c-aeda-25dab1073e66 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Copying metadata from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 to 0deb1387-be0d-412c-aeda-25dab1073e66. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:47:32 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Creating volume glance metadata for volume 0deb1387-be0d-412c-aeda-25dab1073e66 backed by image de3c03b3-c1ea-429a-9d20-5eaeb1379637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46b6edf-186a-4ec4-8812-e1a1de1a21e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0deb1387-be0d-412c-aeda-25dab1073e66', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcee0b1-b289-4071-8c0c-8e74a2d9826b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:33 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Volume volume-0deb1387-be0d-412c-aeda-25dab1073e66 (0deb1387-be0d-412c-aeda-25dab1073e66): created successfully Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcee0b1-b289-4071-8c0c-8e74a2d9826b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Flow 'volume_create_manager' (9ed082bb-c3f9-4ba7-88e8-f3bd7bef52d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dde342b1-978a-4366-b576-582cd61d82aa tempest-VolumesExtendTest-1005845050 None] Created volume successfully. Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0ef091-d6f6-4759-bfc7-f2ead6f7a55d]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:33 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:33 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:34 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:34 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:34 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:35 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 1 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 2G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 2G" returned: 0 in 0.070s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.745s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1e78e3f2-f897-4240-a22b-9999f10cb304 tempest-VolumesExtendTest-1005845050 None] Extend volume completed successfully. Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Acquiring lock "cinder-0deb1387-be0d-412c-aeda-25dab1073e66-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Lock "cinder-0deb1387-be0d-412c-aeda-25dab1073e66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Acquiring lock "cinder-quobyte-0deb1387-be0d-412c-aeda-25dab1073e66" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-0deb1387-be0d-412c-aeda-25dab1073e66" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e249a5-cb51-4971-ab12-a81fcd053181]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:36 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:36 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:36 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:37 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:37 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:37 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 1 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:47:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:37 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66 Jul 09 16:47:37 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:38 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0deb1387-be0d-412c-aeda-25dab1073e66" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-0deb1387-be0d-412c-aeda-25dab1073e66" released by "delete_volume" :: held 2.524s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Created reservations ['43622f25-3f06-41d7-a92b-8684ef178c83', '1d3c9153-e61e-4f7e-9328-9bedd599e557', '3fb5ca1f-25fc-4390-9311-a9381b5a3811', '279fb5fa-ea53-4303-9d04-8f5e73320460'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:38 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:38 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:39 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Deleted volume successfully. Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-448d856a-6881-4e10-bffa-a16c8eb9c09f tempest-VolumesExtendTest-1005845050 None] Lock "cinder-0deb1387-be0d-412c-aeda-25dab1073e66-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Flow 'volume_create_manager' (2f0c8c89-f383-45a7-a01f-be13578e942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8191975-62a8-4d8b-bdc6-b6b218328467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8191975-62a8-4d8b-bdc6-b6b218328467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-367874254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca72289-16d4-477e-8293-1823260215ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81c3fa9c2f74c0e93a0400c2c703fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:40Z,use_quota=True,user_id='382b02e3126249dd891ea775c38ccd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74dc1c3-0412-40a3-93dd-ba00a3bb6b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74dc1c3-0412-40a3-93dd-ba00a3bb6b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a97668d-9290-4e0a-8f46-86d54b019ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a97668d-9290-4e0a-8f46-86d54b019ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca72289-16d4-477e-8293-1823260215ba', 'volume_name': 'volume-aca72289-16d4-477e-8293-1823260215ba', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565339cc-1500-4518-b9bf-b1472311ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565339cc-1500-4518-b9bf-b1472311ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8f0a02-9669-47ec-84cf-f6df6faf8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Volume aca72289-16d4-477e-8293-1823260215ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca72289-16d4-477e-8293-1823260215ba', 'volume_size': 1} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-367874254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca72289-16d4-477e-8293-1823260215ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81c3fa9c2f74c0e93a0400c2c703fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:40Z,use_quota=True,user_id='382b02e3126249dd891ea775c38ccd7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Creating volume aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:47:39 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:47:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:40 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba 1073741824 Jul 09 16:47:40 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:40 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba 1073741824" returned: 0 in 0.938s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:40 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba Jul 09 16:47:40 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:41 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8f0a02-9669-47ec-84cf-f6df6faf8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca72289-16d4-477e-8293-1823260215ba', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9feb4d33-8eef-4cf8-a164-4f38e5a060e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=70,cinder:INSERT=24,cinder:UPDATE=80,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:47:41 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Volume volume-aca72289-16d4-477e-8293-1823260215ba (aca72289-16d4-477e-8293-1823260215ba): created successfully Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9feb4d33-8eef-4cf8-a164-4f38e5a060e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Flow 'volume_create_manager' (2f0c8c89-f383-45a7-a01f-be13578e942d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d0c09762-b16a-4812-aa63-3497126632b0 tempest-VolumesExtendTest-1005845050 None] Created volume successfully. Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=71,cinder:UPDATE=82,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Creating offline snapshot 99ee3363-dba7-486d-af20-b7d738738abc of volume aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af360f-d3c2-4b27-88d0-f4b215077918]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:42 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba Jul 09 16:47:42 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:42 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:42 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc 1G Jul 09 16:47:42 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:43 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc 1G" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca72289-16d4-477e-8293-1823260215ba -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:43 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca72289-16d4-477e-8293-1823260215ba -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc Jul 09 16:47:43 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:44 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca72289-16d4-477e-8293-1823260215ba -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc" returned: 0 in 0.680s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:44 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc is being set with open permissions: ugo+rw Jul 09 16:47:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:44 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc Jul 09 16:47:44 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:44 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc" returned: 0 in 0.665s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:45 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.info Jul 09 16:47:45 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:45 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.info" returned: 0 in 0.679s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:45 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.info is being set with open permissions: ugo+rw Jul 09 16:47:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:45 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.info Jul 09 16:47:45 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:46 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.info" returned: 0 in 0.667s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.279s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d0ef9b29-a650-47c4-8c6a-3bfb0c065d7e tempest-VolumesExtendTest-1005845050 None] Create snapshot completed successfully Jul 09 16:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdaa5cc-67bf-4382-8147-ebfcb0e1d357]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:47 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba Jul 09 16:47:47 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:48 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc 2G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc 2G" returned: 0 in 0.124s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.023s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8b789803-e306-471c-9c3a-7bb0ec1f035e tempest-VolumesExtendTest-1005845050 None] Extend volume completed successfully. Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "cinder-99ee3363-dba7-486d-af20-b7d738738abc-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-99ee3363-dba7-486d-af20-b7d738738abc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "cinder-quobyte-aca72289-16d4-477e-8293-1823260215ba" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-aca72289-16d4-477e-8293-1823260215ba" acquired by "delete_snapshot" :: waited 0.011s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "cinder-quobyte-99ee3363-dba7-486d-af20-b7d738738abc" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-99ee3363-dba7-486d-af20-b7d738738abc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Deleting offline snapshot 99ee3363-dba7-486d-af20-b7d738738abc of volume aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] snapshot_file for this snap is: volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df8244-0c29-4406-943d-2b3f98822e46]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:49 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc Jul 09 16:47:49 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-19db5b50-247a-451b-b0bb-1fc594317984 tempest-TestShelveInstance-1774774990 None] Terminate volume connection completed successfully. Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-19db5b50-247a-451b-b0bb-1fc594317984 tempest-TestShelveInstance-1774774990 None] Deleting attachment a92a24ab-3e57-4bd5-ae15-2706e47ff0e2. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:47:50 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aca72289-16d4-477e-8293-1823260215ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a454f9-28ad-49cc-972c-7c878035744b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:50 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba Jul 09 16:47:50 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Acquiring lock "cinder-76bd2259-884e-4a3c-afc3-ecc6fe475238-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Lock "cinder-76bd2259-884e-4a3c-afc3-ecc6fe475238-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Acquiring lock "cinder-quobyte-76bd2259-884e-4a3c-afc3-ecc6fe475238" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Lock "cinder-quobyte-76bd2259-884e-4a3c-afc3-ecc6fe475238" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f702a-f70c-4081-a713-1e1a49740602]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:50 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:47:50 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:51 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba" returned: 0 in 0.801s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:51 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc Jul 09 16:47:51 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:51 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:51 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:47:51 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:52 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc" returned: 0 in 0.761s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:52 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc Jul 09 16:47:52 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:52 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 1 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:52 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238 Jul 09 16:47:52 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:52 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba.99ee3363-dba7-486d-af20-b7d738738abc" returned: 0 in 0.631s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-99ee3363-dba7-486d-af20-b7d738738abc" released by "_delete_snapshot" :: held 3.047s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-aca72289-16d4-477e-8293-1823260215ba" released by "delete_snapshot" :: held 3.066s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Created reservations ['b122c39e-c5c0-47ad-87fa-da12bdf57d4d', '8918d14a-2f40-4124-b455-afdcb17eafa3', '2eba9e88-48c7-4228-84de-787c7e6468db', 'e9652941-c9d3-434e-bcd5-6febc7ea618f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Delete snapshot completed successfully. Jul 09 16:47:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-89cdb61f-6496-4e47-851c-b758d9276458 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-99ee3363-dba7-486d-af20-b7d738738abc-delete_snapshot" released by "delete_snapshot" :: held 3.209s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:53 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-76bd2259-884e-4a3c-afc3-ecc6fe475238" returned: 0 in 0.692s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Lock "cinder-quobyte-76bd2259-884e-4a3c-afc3-ecc6fe475238" released by "delete_volume" :: held 2.290s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG cinder.quota [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Created reservations ['073da264-1b13-4500-81e1-8748b47fe08e', '169ecbdc-5343-4ebb-8c0b-9bd26a8fc854', '55938c28-a2f8-48a1-8201-b2a6acd661ce', '1ea6bbf3-6386-4a07-9143-e61296dffcff'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:53 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:53 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:53 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.699s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG cinder.manager [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Deleted volume successfully. Jul 09 16:47:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [req-5f13cadb-2dfd-4e6d-aedc-d3294022edbd req-7138e01a-c3a2-4cd9-ab21-85641c95b95b tempest-TestShelveInstance-1774774990 None] Lock "cinder-76bd2259-884e-4a3c-afc3-ecc6fe475238-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "cinder-aca72289-16d4-477e-8293-1823260215ba-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-aca72289-16d4-477e-8293-1823260215ba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "cinder-quobyte-aca72289-16d4-477e-8293-1823260215ba" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-aca72289-16d4-477e-8293-1823260215ba" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ee4e8-2c94-4438-b21a-d1e910bc841b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:54 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba Jul 09 16:47:54 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:54 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:54 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba Jul 09 16:47:54 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:55 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-aca72289-16d4-477e-8293-1823260215ba" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-quobyte-aca72289-16d4-477e-8293-1823260215ba" released by "delete_volume" :: held 1.556s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Created reservations ['de458ac8-12d0-4b81-8a81-21bf6b20fb25', 'b6e6cb87-43ed-460c-a60a-daa08b859eee', '6a2b6149-57a0-4d36-b2e2-0766e20f1b39', '5acf45e2-058b-43a0-a712-baf9230ff54d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:55 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:47:55 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:47:56 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 09 16:47:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:47:56 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:47:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Deleted volume successfully. Jul 09 16:47:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38b12727-0acf-480b-a295-c0ba9fe03077 tempest-VolumesExtendTest-1005845050 None] Lock "cinder-aca72289-16d4-477e-8293-1823260215ba-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (d4a17c66-0037-4feb-8cb5-b8c985381f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff6e908-ee68-4442-a5a1-1b5d1138fdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff6e908-ee68-4442-a5a1-1b5d1138fdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-839287605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4154b4b4-079f-4197-8c18-aaf445a319b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:59Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f06211-35b8-477f-82be-c77cac890365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f06211-35b8-477f-82be-c77cac890365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f220f8-5a9e-4a93-98eb-0f22a2a204c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f220f8-5a9e-4a93-98eb-0f22a2a204c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4154b4b4-079f-4197-8c18-aaf445a319b5', 'volume_name': 'volume-4154b4b4-079f-4197-8c18-aaf445a319b5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089d88d8-d82d-489c-bf30-29598a6e6dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089d88d8-d82d-489c-bf30-29598a6e6dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32825f25-8a2c-443c-b2e6-9239aa45bf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:47:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Volume 4154b4b4-079f-4197-8c18-aaf445a319b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4154b4b4-079f-4197-8c18-aaf445a319b5', 'volume_size': 1} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-839287605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4154b4b4-079f-4197-8c18-aaf445a319b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:47:59Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Creating volume 4154b4b4-079f-4197-8c18-aaf445a319b5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:47:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:47:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:47:59 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 1073741824 Jul 09 16:47:59 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:00 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 1073741824" returned: 0 in 0.928s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:00 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 Jul 09 16:48:00 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:01 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:48:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32825f25-8a2c-443c-b2e6-9239aa45bf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4154b4b4-079f-4197-8c18-aaf445a319b5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e510d2-3400-4959-8e1e-8548d7a724e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Volume volume-4154b4b4-079f-4197-8c18-aaf445a319b5 (4154b4b4-079f-4197-8c18-aaf445a319b5): created successfully Jul 09 16:48:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e510d2-3400-4959-8e1e-8548d7a724e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (d4a17c66-0037-4feb-8cb5-b8c985381f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-50470102-06c2-4b7d-b847-0387d3f9cda9 tempest-VolumesGetTest-542998488 None] Created volume successfully. Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (896d02b7-baee-41d3-861d-33e8ac9f2119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce05559-3128-480f-ad26-baff0a7300f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce05559-3128-480f-ad26-baff0a7300f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-123886460',display_name='tempest-VolumesGetTest-Volume-1331308428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6c1d49-3305-485c-81a3-07c00dee47ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:02Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b76ef15-219f-43dc-8d69-45e8074bb7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b76ef15-219f-43dc-8d69-45e8074bb7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a942c4d-d24f-4128-a1e6-fdaa8d013d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a942c4d-d24f-4128-a1e6-fdaa8d013d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6c1d49-3305-485c-81a3-07c00dee47ea', 'volume_name': 'volume-ef6c1d49-3305-485c-81a3-07c00dee47ea', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cb86e6-493f-4977-94c5-906f19c27b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96cb86e6-493f-4977-94c5-906f19c27b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148b197d-d4b3-4023-99a6-dd1417e2c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Volume ef6c1d49-3305-485c-81a3-07c00dee47ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6c1d49-3305-485c-81a3-07c00dee47ea', 'volume_size': 1} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-123886460',display_name='tempest-VolumesGetTest-Volume-1331308428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6c1d49-3305-485c-81a3-07c00dee47ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:02Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Creating volume ef6c1d49-3305-485c-81a3-07c00dee47ea {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:48:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:48:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:02 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea 1073741824 Jul 09 16:48:02 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:03 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea 1073741824" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:03 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea Jul 09 16:48:03 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:03 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea" returned: 0 in 0.674s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148b197d-d4b3-4023-99a6-dd1417e2c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6c1d49-3305-485c-81a3-07c00dee47ea', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfeb4ae-ae5b-4ef7-b82c-083a57b979b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Volume volume-ef6c1d49-3305-485c-81a3-07c00dee47ea (ef6c1d49-3305-485c-81a3-07c00dee47ea): created successfully Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfeb4ae-ae5b-4ef7-b82c-083a57b979b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (896d02b7-baee-41d3-861d-33e8ac9f2119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-203a9f65-5408-41a6-8b97-c7aabc965915 tempest-VolumesGetTest-542998488 None] Created volume successfully. Jul 09 16:48:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-ef6c1d49-3305-485c-81a3-07c00dee47ea-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Lock "cinder-ef6c1d49-3305-485c-81a3-07c00dee47ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-ef6c1d49-3305-485c-81a3-07c00dee47ea" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-ef6c1d49-3305-485c-81a3-07c00dee47ea" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:04 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d691827-7d94-4e35-bc99-a9d62ea6a5dc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:04 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea Jul 09 16:48:04 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:05 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea" returned: 0 in 0.818s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:05 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea Jul 09 16:48:05 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:06 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-ef6c1d49-3305-485c-81a3-07c00dee47ea" returned: 0 in 0.693s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-ef6c1d49-3305-485c-81a3-07c00dee47ea" released by "delete_volume" :: held 1.556s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Created reservations ['286f4a56-53bf-4017-a01b-f67857c86b5b', '9187d478-ae53-46d8-9a28-f44d97beba36', '9176ca2c-6a61-49d4-9c12-489aab5380a0', '549b17d8-f5db-4f4a-bca3-a27eb4654864'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:06 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:48:06 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-4154b4b4-079f-4197-8c18-aaf445a319b5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Lock "cinder-4154b4b4-079f-4197-8c18-aaf445a319b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-4154b4b4-079f-4197-8c18-aaf445a319b5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-4154b4b4-079f-4197-8c18-aaf445a319b5" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6745e4-40c7-48e8-9475-5b46bd8652bb]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:06 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.682s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:48:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Deleted volume successfully. Jul 09 16:48:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eeb15f72-8b86-4e9d-8cb0-875fe49d1d57 tempest-VolumesGetTest-542998488 None] Lock "cinder-ef6c1d49-3305-485c-81a3-07c00dee47ea-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:06 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 Jul 09 16:48:06 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:07 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:07 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5 Jul 09 16:48:07 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:08 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4154b4b4-079f-4197-8c18-aaf445a319b5" returned: 0 in 0.718s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-4154b4b4-079f-4197-8c18-aaf445a319b5" released by "delete_volume" :: held 1.565s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Created reservations ['7d8f5c6e-0a7c-414a-9875-f79b91a7bf90', 'bf8ce448-d62f-4ac5-b02e-cfa4e933c77e', '71949768-016d-4de5-8378-93bd6dba175c', 'f43598c6-cae0-42a4-9683-1a7af7eb0469'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:08 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:48:08 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:09 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:48:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Deleted volume successfully. Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b406edb6-f29e-4c34-95de-738133f0a3f9 tempest-VolumesGetTest-542998488 None] Lock "cinder-4154b4b4-079f-4197-8c18-aaf445a319b5-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (49585ce2-6aed-471a-afde-7e191232530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0544f72-332e-4f77-a878-1a6f238b7831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0544f72-332e-4f77-a878-1a6f238b7831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1802612379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22076633-bee6-48b3-a181-faa1ea5e4d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:10Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c522407-5a41-420a-9a67-93f8d530d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c522407-5a41-420a-9a67-93f8d530d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c37a51-31a0-4bcd-87c5-11b6f92cf759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c37a51-31a0-4bcd-87c5-11b6f92cf759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22076633-bee6-48b3-a181-faa1ea5e4d7f', 'volume_name': 'volume-22076633-bee6-48b3-a181-faa1ea5e4d7f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963342c6-0dc7-469b-9071-815297d7a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963342c6-0dc7-469b-9071-815297d7a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f81f37f-55e6-479f-811e-76ba215b5978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Volume 22076633-bee6-48b3-a181-faa1ea5e4d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22076633-bee6-48b3-a181-faa1ea5e4d7f', 'volume_size': 1} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1802612379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22076633-bee6-48b3-a181-faa1ea5e4d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:10Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Creating volume 22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:48:09 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:48:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:09 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f 1073741824 Jul 09 16:48:09 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:10 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f 1073741824" returned: 0 in 0.919s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:10 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f Jul 09 16:48:10 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:11 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f" returned: 0 in 0.687s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:48:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f81f37f-55e6-479f-811e-76ba215b5978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22076633-bee6-48b3-a181-faa1ea5e4d7f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cf5e33-9a5a-42f3-a30c-ec471070e764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:11 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Volume volume-22076633-bee6-48b3-a181-faa1ea5e4d7f (22076633-bee6-48b3-a181-faa1ea5e4d7f): created successfully Jul 09 16:48:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cf5e33-9a5a-42f3-a30c-ec471070e764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (49585ce2-6aed-471a-afde-7e191232530d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e0f5e042-3199-480a-81a9-5c34e67cb542 tempest-VolumesGetTest-542998488 None] Created volume successfully. Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (b4d59822-0b9c-48d0-9e0a-ce8c1fa8df74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3ca06-597e-4227-b9e8-230d93828eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f3ca06-597e-4227-b9e8-230d93828eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1839693918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223216be-651c-4562-88c1-3ff5a9d90a67,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=22076633-bee6-48b3-a181-faa1ea5e4d7f,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:12Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c900e40e-07ba-4ea9-89c9-f929fb4b1192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c900e40e-07ba-4ea9-89c9-f929fb4b1192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7603ab4-458d-4094-9c08-8000a176b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7603ab4-458d-4094-9c08-8000a176b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '223216be-651c-4562-88c1-3ff5a9d90a67', 'volume_name': 'volume-223216be-651c-4562-88c1-3ff5a9d90a67', 'volume_size': 1, 'source_volid': '22076633-bee6-48b3-a181-faa1ea5e4d7f', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c917f-c900-4cd1-879a-626e376c6c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c917f-c900-4cd1-879a-626e376c6c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0d7ea7-1ee9-48a9-9ff7-046e9c28a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Volume 223216be-651c-4562-88c1-3ff5a9d90a67: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-223216be-651c-4562-88c1-3ff5a9d90a67', 'volume_size': 1, 'source_volid': '22076633-bee6-48b3-a181-faa1ea5e4d7f', 'source_volstatus': 'available'} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:12 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Cloning volume 22076633-bee6-48b3-a181-faa1ea5e4d7f to volume 223216be-651c-4562-88c1-3ff5a9d90a67 Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Creating offline snapshot dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 of volume 22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9711b76-e2da-4cb7-a21e-9164a8a5cefd]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:12 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f Jul 09 16:48:12 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:13 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:13 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 1G Jul 09 16:48:13 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:14 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 1G" returned: 0 in 0.836s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22076633-bee6-48b3-a181-faa1ea5e4d7f -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:14 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22076633-bee6-48b3-a181-faa1ea5e4d7f -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 Jul 09 16:48:14 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:14 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22076633-bee6-48b3-a181-faa1ea5e4d7f -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" returned: 0 in 0.692s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:14 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 is being set with open permissions: ugo+rw Jul 09 16:48:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:14 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 Jul 09 16:48:14 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:15 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" returned: 0 in 0.685s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:15 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.info Jul 09 16:48:15 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:16 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.info" returned: 0 in 0.691s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:16 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.info is being set with open permissions: ugo+rw Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:16 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.info Jul 09 16:48:16 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:16 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.info" returned: 0 in 0.630s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-223216be-651c-4562-88c1-3ff5a9d90a67" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-223216be-651c-4562-88c1-3ff5a9d90a67" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] snapshot: dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6, volume: 223216be-651c-4562-88c1-3ff5a9d90a67, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef175556-d817-438b-a3c4-218843f66a8e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:17 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 Jul 09 16:48:17 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:17 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22076633-bee6-48b3-a181-faa1ea5e4d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:48:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:48:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:48:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b0a04d-40f3-4b96-a9a9-afb25926df16]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:17 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f Jul 09 16:48:17 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:18 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:18 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:48:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:18 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 Jul 09 16:48:18 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:24 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67" returned: 0 in 5.537s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d28042-dc91-4990-bb2d-b9f7b6686933]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:24 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f Jul 09 16:48:24 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:25 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f" returned: 0 in 0.985s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:48:25 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Converted 1024.00 MB image at 184.90 MB/s Jul 09 16:48:25 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 is being set with open permissions: ugo+rw Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:25 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 Jul 09 16:48:25 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=41,cinder:INSERT=16,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=51,cinder:SELECT=41,cinder:DELETE=5,cinder:INSERT=10 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:48:25 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67" returned: 0 in 0.727s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-223216be-651c-4562-88c1-3ff5a9d90a67" released by "_copy_volume_from_snapshot" :: held 9.044s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Deleting offline snapshot dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 of volume 22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] snapshot_file for this snap is: volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab28e5-1ffa-4143-9962-552878795af9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:26 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 Jul 09 16:48:26 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:26 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22076633-bee6-48b3-a181-faa1ea5e4d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:48:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe5e199-af5b-4b22-8eea-7173ee0cc235]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:26 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f Jul 09 16:48:26 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:27 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:27 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 Jul 09 16:48:27 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Flow 'volume_create_manager' (033d4ca9-4a2d-4c6a-a8f1-8e1a45f2d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994741c-8b1a-4115-9529-fb80c601eb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994741c-8b1a-4115-9529-fb80c601eb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1805602854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b3999d-7853-40f2-b0e3-3228bbe71995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c540d42a064a2eaf44dc14be87fcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:28Z,use_quota=True,user_id='33bc66afea124e30a8bfe3e1101afda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5934c380-8250-4477-9efd-46d008596112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5934c380-8250-4477-9efd-46d008596112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aef7f37-2a9c-4d28-a53d-b9d6c7ab06cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aef7f37-2a9c-4d28-a53d-b9d6c7ab06cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b3999d-7853-40f2-b0e3-3228bbe71995', 'volume_name': 'volume-35b3999d-7853-40f2-b0e3-3228bbe71995', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da7d755-bb37-456b-81f4-92180163d40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da7d755-bb37-456b-81f4-92180163d40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d2378d-25d1-4862-8439-bab97e7bc843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Volume 35b3999d-7853-40f2-b0e3-3228bbe71995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b3999d-7853-40f2-b0e3-3228bbe71995', 'volume_size': 1} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:28 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:28 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6 Jul 09 16:48:28 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:28 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:48:28 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:29 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f.dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-dc4e96a7-bac7-4df1-90b3-2a7f5c990ef6" released by "_delete_snapshot" :: held 3.188s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.789s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1805602854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b3999d-7853-40f2-b0e3-3228bbe71995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c540d42a064a2eaf44dc14be87fcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:28Z,use_quota=True,user_id='33bc66afea124e30a8bfe3e1101afda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Creating volume 35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:48:29 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:29 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 1073741824 Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0d7ea7-1ee9-48a9-9ff7-046e9c28a547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223216be-651c-4562-88c1-3ff5a9d90a67', 'volume_size': 1, 'source_volid': '22076633-bee6-48b3-a181-faa1ea5e4d7f', 'source_volstatus': 'available'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:29 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9ff3a8-9676-421f-b186-72ec0adbabe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Volume volume-223216be-651c-4562-88c1-3ff5a9d90a67 (223216be-651c-4562-88c1-3ff5a9d90a67): created successfully Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9ff3a8-9676-421f-b186-72ec0adbabe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (b4d59822-0b9c-48d0-9e0a-ce8c1fa8df74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a08aa9ea-032d-4ddf-87f7-f274acd4cb4d tempest-VolumesGetTest-542998488 None] Created volume successfully. Jul 09 16:48:29 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:48:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:48:30 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 1073741824" returned: 0 in 1.044s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:30 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:48:30 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (62f9120d-ff07-4b05-8781-65057f0dfef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d6f544-9c41-4e23-b29a-3a90bdb628fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d6f544-9c41-4e23-b29a-3a90bdb628fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-599151269',display_name='tempest-VolumesGetTest-Volume-1084280353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059a9f22-b84c-4402-90bf-bc26c38a0396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:30Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52947f51-22c9-42d2-b6aa-533f70b2d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52947f51-22c9-42d2-b6aa-533f70b2d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8116ea02-2c2e-4aff-87e7-f71aeec043a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8116ea02-2c2e-4aff-87e7-f71aeec043a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059a9f22-b84c-4402-90bf-bc26c38a0396', 'volume_name': 'volume-059a9f22-b84c-4402-90bf-bc26c38a0396', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5b205a-7601-415f-81cf-68272f14cf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5b205a-7601-415f-81cf-68272f14cf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c08174-d151-4b4f-ad67-04262f0f8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Volume 059a9f22-b84c-4402-90bf-bc26c38a0396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059a9f22-b84c-4402-90bf-bc26c38a0396', 'volume_size': 1} Jul 09 16:48:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:31 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 0.788s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-599151269',display_name='tempest-VolumesGetTest-Volume-1084280353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059a9f22-b84c-4402-90bf-bc26c38a0396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:30Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Creating volume 059a9f22-b84c-4402-90bf-bc26c38a0396 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:48:31 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:31 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 1073741824 Jul 09 16:48:31 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d2378d-25d1-4862-8439-bab97e7bc843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b3999d-7853-40f2-b0e3-3228bbe71995', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7fd8c1-8870-42c9-8f11-772889bec094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Volume volume-35b3999d-7853-40f2-b0e3-3228bbe71995 (35b3999d-7853-40f2-b0e3-3228bbe71995): created successfully Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7fd8c1-8870-42c9-8f11-772889bec094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Flow 'volume_create_manager' (033d4ca9-4a2d-4c6a-a8f1-8e1a45f2d31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5311b532-7b07-422a-a538-318243b66dff tempest-TestStampPattern-613059521 None] Created volume successfully. Jul 09 16:48:31 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 1073741824" returned: 0 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:31 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 Jul 09 16:48:31 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:32 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396" returned: 0 in 0.658s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:48:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c08174-d151-4b4f-ad67-04262f0f8e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059a9f22-b84c-4402-90bf-bc26c38a0396', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beec0634-a432-4fed-8fb7-1881f71cc9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:32 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Volume volume-059a9f22-b84c-4402-90bf-bc26c38a0396 (059a9f22-b84c-4402-90bf-bc26c38a0396): created successfully Jul 09 16:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beec0634-a432-4fed-8fb7-1881f71cc9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:32 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (62f9120d-ff07-4b05-8781-65057f0dfef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cc4b8d33-7eea-4140-9f2e-2c1f27cdb6f6 tempest-VolumesGetTest-542998488 None] Created volume successfully. Jul 09 16:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-059a9f22-b84c-4402-90bf-bc26c38a0396-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Lock "cinder-059a9f22-b84c-4402-90bf-bc26c38a0396-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-059a9f22-b84c-4402-90bf-bc26c38a0396" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-059a9f22-b84c-4402-90bf-bc26c38a0396" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a33645-a23a-4c72-af65-f3868de221be]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:33 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 Jul 09 16:48:33 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:34 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:34 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396 Jul 09 16:48:34 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:35 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-059a9f22-b84c-4402-90bf-bc26c38a0396" returned: 0 in 0.711s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-059a9f22-b84c-4402-90bf-bc26c38a0396" released by "delete_volume" :: held 1.631s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Created reservations ['979df821-4538-4ecc-b48b-16f236dfde70', 'e078e617-5d49-49d7-b7c4-dba3134797e9', 'f799bbbd-914b-4489-b226-00be263f5665', '85b5da8d-ff77-4737-87cb-46a8389eba25'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:35 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:48:35 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-223216be-651c-4562-88c1-3ff5a9d90a67-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Lock "cinder-223216be-651c-4562-88c1-3ff5a9d90a67-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-223216be-651c-4562-88c1-3ff5a9d90a67" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-223216be-651c-4562-88c1-3ff5a9d90a67" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2ed4fe-b013-4cda-8a31-feb3294f138d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:36 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:48:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Deleted volume successfully. Jul 09 16:48:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d504e883-e713-4012-92eb-1109ccb02054 tempest-VolumesGetTest-542998488 None] Lock "cinder-059a9f22-b84c-4402-90bf-bc26c38a0396-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:36 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 Jul 09 16:48:36 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:37 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:37 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67 Jul 09 16:48:37 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:37 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-223216be-651c-4562-88c1-3ff5a9d90a67" returned: 0 in 0.697s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-223216be-651c-4562-88c1-3ff5a9d90a67" released by "delete_volume" :: held 1.488s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Created reservations ['23b8bb29-f121-4a05-beb8-7b7d72fa2847', 'ce58eb87-97a8-478f-b549-9b020c5d2889', '2235bb56-1d3d-4307-881c-0247ac24461f', '9cbcb70b-3e73-459e-ac4d-05d0f780b16f'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:37 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:48:37 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-22076633-bee6-48b3-a181-faa1ea5e4d7f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:38 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.666s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Lock "cinder-22076633-bee6-48b3-a181-faa1ea5e4d7f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Deleted volume successfully. Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c28dd60c-d758-4777-a28c-b21efe844845 tempest-VolumesGetTest-542998488 None] Lock "cinder-223216be-651c-4562-88c1-3ff5a9d90a67-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-22076633-bee6-48b3-a181-faa1ea5e4d7f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-22076633-bee6-48b3-a181-faa1ea5e4d7f" acquired by "delete_volume" :: waited 0.012s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[46201390-05e9-4c73-b480-0f718f9fd0d6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:38 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f Jul 09 16:48:38 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:39 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f" returned: 0 in 0.999s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:39 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f Jul 09 16:48:39 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:40 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-22076633-bee6-48b3-a181-faa1ea5e4d7f" returned: 0 in 0.654s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-22076633-bee6-48b3-a181-faa1ea5e4d7f" released by "delete_volume" :: held 1.716s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Created reservations ['52f9cdeb-7ec6-45e4-806f-166b9cb8122c', '12c0500b-51fb-40b8-8139-499273451c5d', 'f4b2f3b9-fc18-47a8-9b74-d85d75613028', 'e543f354-59c6-428d-91d3-ae1c2fc0281c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:40 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:48:40 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:41 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.682s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:48:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Deleted volume successfully. Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ba33d4d1-8e6a-475d-a88d-9dee6e688582 tempest-VolumesGetTest-542998488 None] Lock "cinder-22076633-bee6-48b3-a181-faa1ea5e4d7f-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (28beb1b3-10c9-4ed2-bf50-0af1e39197df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31501f1e-cfa8-47c6-80d5-9e5788625971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31501f1e-cfa8-47c6-80d5-9e5788625971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-506932708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290fa543-f156-4350-9f98-269e72496817,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:42Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d11c7a-1099-43b2-a27d-2267c136b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d11c7a-1099-43b2-a27d-2267c136b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8beef79-2cd5-425c-b204-0fb58507428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:48:41 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8beef79-2cd5-425c-b204-0fb58507428d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '290fa543-f156-4350-9f98-269e72496817', 'volume_name': 'volume-290fa543-f156-4350-9f98-269e72496817', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054dab76-d87e-4504-be2d-11e32bb64a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054dab76-d87e-4504-be2d-11e32bb64a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:42 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf52543-39d0-4518-9871-cd4ba8f25dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:42 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Volume 290fa543-f156-4350-9f98-269e72496817: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-290fa543-f156-4350-9f98-269e72496817', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 16:48:42 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Trying to clone 290fa543-f156-4350-9f98-269e72496817 from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:48:42 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:48:42 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Image download 20.69 MB at 20.69 MB/s Jul 09 16:48:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc61bcf-72ce-4194-aba9-f9c0a54f0b4d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:42 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD Jul 09 16:48:42 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:43 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:43 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 is fetched for user ce09b70dfb7e463d8f60f0f2a7b96987. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:48:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[362332bd-44e7-4b68-9c59-3c343a2d8f97]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:43 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD Jul 09 16:48:43 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:44 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-506932708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290fa543-f156-4350-9f98-269e72496817,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:42Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Creating volume 290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:48:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:48:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:44 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 1073741824 Jul 09 16:48:44 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:45 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 1073741824" returned: 0 in 0.891s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:45 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 Jul 09 16:48:45 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:45 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817" returned: 0 in 0.732s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Attempting download of de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 290fa543-f156-4350-9f98-269e72496817. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c3905d-62f2-4271-9144-7ca3e2f3561c]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_u1cd3535 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:46 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_u1cd3535 Jul 09 16:48:46 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:46 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_u1cd3535" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_u1cd3535 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:46 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_u1cd3535 Jul 09 16:48:46 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:47 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_u1cd3535" returned: 1 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de3c03b3-c1ea-429a-9d20-5eaeb1379637_u1cd3535' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:48:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e20215-5442-4b9b-b14b-a77c56667860]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:47 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD Jul 09 16:48:47 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:48 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:48 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] de3c03b3-c1ea-429a-9d20-5eaeb1379637 was qcow2, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:48:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:48 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 Jul 09 16:48:48 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:49 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817" returned: 0 in 1.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:49 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de3c03b3-c1ea-429a-9d20-5eaeb1379637_ze5o1ui7devstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:48:49 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Converted 112.00 MB image at 64.03 MB/s Jul 09 16:48:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:49 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 1G Jul 09 16:48:50 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:50 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 1G" returned: 0 in 0.713s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f955c2f2-42cf-487f-8ad6-3bef4b8d797d]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:50 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 Jul 09 16:48:50 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:51 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817" returned: 0 in 0.820s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:51 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 Jul 09 16:48:51 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:52 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817" returned: 1 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Downloaded image de3c03b3-c1ea-429a-9d20-5eaeb1379637 ((None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}])) to volume 290fa543-f156-4350-9f98-269e72496817 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Temporary image de3c03b3-c1ea-429a-9d20-5eaeb1379637 for user ce09b70dfb7e463d8f60f0f2a7b96987 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Marking volume 290fa543-f156-4350-9f98-269e72496817 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Copying metadata from image de3c03b3-c1ea-429a-9d20-5eaeb1379637 to 290fa543-f156-4350-9f98-269e72496817. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Creating volume glance metadata for volume 290fa543-f156-4350-9f98-269e72496817 backed by image de3c03b3-c1ea-429a-9d20-5eaeb1379637 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf52543-39d0-4518-9871-cd4ba8f25dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290fa543-f156-4350-9f98-269e72496817', 'volume_size': 1, 'image_id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0b99e18f814a46a4a6c4072d3bc45271', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de3c03b3-c1ea-429a-9d20-5eaeb1379637', 'created_at': datetime.datetime(2026, 7, 9, 14, 24, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de3c03b3-c1ea-429a-9d20-5eaeb1379637/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc24e46-9d2e-4710-b4a9-0abab571d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Volume volume-290fa543-f156-4350-9f98-269e72496817 (290fa543-f156-4350-9f98-269e72496817): created successfully Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc24e46-9d2e-4710-b4a9-0abab571d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (28beb1b3-10c9-4ed2-bf50-0af1e39197df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2f0589e5-475b-4313-b248-79b8afb6852b tempest-VolumesGetTest-542998488 None] Created volume successfully. Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (7dfe5843-553f-4d4f-99c8-e4efec1ed54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e9a76d-80b1-4350-92d6-59c2cc353a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e9a76d-80b1-4350-92d6-59c2cc353a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-618281386',display_name='tempest-VolumesGetTest-Volume-853127471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13acdf5-b80e-4cfd-aa98-7ee6b56451bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:54Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58376be2-1b64-406a-8fe4-379f794f5877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58376be2-1b64-406a-8fe4-379f794f5877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d308fb59-2222-4687-8fff-7394bea35793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d308fb59-2222-4687-8fff-7394bea35793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13acdf5-b80e-4cfd-aa98-7ee6b56451bd', 'volume_name': 'volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b294b6-affc-491e-8d5a-561bf68dbe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b294b6-affc-491e-8d5a-561bf68dbe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacf7312-47fd-41c1-b8a2-0c5bcd824181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Volume f13acdf5-b80e-4cfd-aa98-7ee6b56451bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd', 'volume_size': 1} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:48:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-618281386',display_name='tempest-VolumesGetTest-Volume-853127471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13acdf5-b80e-4cfd-aa98-7ee6b56451bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b30aec75ca4435fb723bcffa4983b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:48:54Z,use_quota=True,user_id='ce09b70dfb7e463d8f60f0f2a7b96987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Creating volume f13acdf5-b80e-4cfd-aa98-7ee6b56451bd {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:48:54 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:48:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:54 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd 1073741824 Jul 09 16:48:54 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:54 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd 1073741824" returned: 0 in 0.767s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:54 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd Jul 09 16:48:54 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:55 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd" returned: 0 in 0.646s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:48:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacf7312-47fd-41c1-b8a2-0c5bcd824181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b05213e-df6f-4b2f-8165-cecc3dc2487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:48:55 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Volume volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd (f13acdf5-b80e-4cfd-aa98-7ee6b56451bd): created successfully Jul 09 16:48:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b05213e-df6f-4b2f-8165-cecc3dc2487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:48:55 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Flow 'volume_create_manager' (7dfe5843-553f-4d4f-99c8-e4efec1ed54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:48:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-50284c6a-ce63-4c82-b098-86a77b0e24ca tempest-VolumesGetTest-542998488 None] Created volume successfully. Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Lock "cinder-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[011762ba-cd94-456b-9082-91087e68c775]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:56 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd Jul 09 16:48:56 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:56 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd" returned: 0 in 0.749s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:56 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd Jul 09 16:48:56 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:57 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd" returned: 0 in 0.658s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd" released by "delete_volume" :: held 1.443s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Created reservations ['c0869630-dbc2-4753-8189-f0e0fe2231e0', '71198c79-36c3-47ce-a98e-a514d525e1ed', 'e49640fe-17fe-4ace-915d-716b49a4a7e7', '9485ba0e-ad0b-4d5e-a421-e11434767677'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:48:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:57 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:48:57 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:58 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-290fa543-f156-4350-9f98-269e72496817-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.668s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:48:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Deleted volume successfully. Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Lock "cinder-290fa543-f156-4350-9f98-269e72496817-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8b3cd4de-2c6b-4bac-906b-761b140c225b tempest-VolumesGetTest-542998488 None] Lock "cinder-f13acdf5-b80e-4cfd-aa98-7ee6b56451bd-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Acquiring lock "cinder-quobyte-290fa543-f156-4350-9f98-269e72496817" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-290fa543-f156-4350-9f98-269e72496817" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8184e7-e616-43c9-af92-f14bcd1f3b77]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:48:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:58 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 Jul 09 16:48:58 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:59 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817" returned: 0 in 0.746s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:48:59 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 Jul 09 16:48:59 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:48:59 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jul 09 16:48:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817" returned: 1 in 0.753s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:48:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:48:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:00 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817 Jul 09 16:49:00 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:00 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-290fa543-f156-4350-9f98-269e72496817" returned: 0 in 0.669s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Lock "cinder-quobyte-290fa543-f156-4350-9f98-269e72496817" released by "delete_volume" :: held 2.231s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Created reservations ['3a3e4071-fde2-435d-a5f8-e3938157cda7', '4fa605ce-12c6-4a7d-913a-59701f5b8da5', '33af27c0-f233-4255-a695-87e9cae61144', '2a6ce956-682a-4ed1-98e6-e224829c5916'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:00 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:49:00 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:01 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.651s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:01 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:49:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Deleted volume successfully. Jul 09 16:49:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-1bea490a-c90c-4119-9319-d3d30cf3d3c2 tempest-VolumesGetTest-542998488 None] Lock "cinder-290fa543-f156-4350-9f98-269e72496817-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Flow 'volume_create_manager' (9ba257b6-31ef-4e5c-8473-55abbaa8bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247fb92a-a36e-4854-b51b-c461977b3e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247fb92a-a36e-4854-b51b-c461977b3e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1958995408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd54674-19de-40da-b8c2-25519a8ef13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76b3d761dab48d59c5729825c8c1d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:49:06Z,use_quota=True,user_id='762a6ba204e14e42bc7129d47ef49eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f97bb0-8c98-4fed-adfc-b99241b816b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f97bb0-8c98-4fed-adfc-b99241b816b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932bc067-f6fc-4c8e-861f-766feed74369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932bc067-f6fc-4c8e-861f-766feed74369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd54674-19de-40da-b8c2-25519a8ef13a', 'volume_name': 'volume-0dd54674-19de-40da-b8c2-25519a8ef13a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d696a581-cfa8-42fe-b731-3383fdf4ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d696a581-cfa8-42fe-b731-3383fdf4ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f05eeda-eee9-45d4-a3f8-3975c763bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:06 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Volume 0dd54674-19de-40da-b8c2-25519a8ef13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd54674-19de-40da-b8c2-25519a8ef13a', 'volume_size': 1} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1958995408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd54674-19de-40da-b8c2-25519a8ef13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76b3d761dab48d59c5729825c8c1d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:49:06Z,use_quota=True,user_id='762a6ba204e14e42bc7129d47ef49eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Creating volume 0dd54674-19de-40da-b8c2-25519a8ef13a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:49:06 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:49:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:06 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a 1073741824 Jul 09 16:49:06 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:07 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a 1073741824" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:07 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a Jul 09 16:49:07 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:07 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a" returned: 0 in 0.636s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:49:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f05eeda-eee9-45d4-a3f8-3975c763bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd54674-19de-40da-b8c2-25519a8ef13a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d418abe4-1c08-46c8-b471-52ac6da1bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Volume volume-0dd54674-19de-40da-b8c2-25519a8ef13a (0dd54674-19de-40da-b8c2-25519a8ef13a): created successfully Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d418abe4-1c08-46c8-b471-52ac6da1bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Flow 'volume_create_manager' (9ba257b6-31ef-4e5c-8473-55abbaa8bb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:49:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-517d7abc-29ac-4c7f-89fc-ba28195a3df4 tempest-VolumesNegativeTest-971992995 None] Created volume successfully. Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-e089b0f3-dd70-4b88-84bf-1f94634d983f req-4e1a2a79-1fc4-4a0b-af31-d9a3803fb28f tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-e089b0f3-dd70-4b88-84bf-1f94634d983f req-4e1a2a79-1fc4-4a0b-af31-d9a3803fb28f tempest-TestStampPattern-613059521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[224d7f1a-5c48-430c-a725-fa33e12b611f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-e089b0f3-dd70-4b88-84bf-1f94634d983f req-4e1a2a79-1fc4-4a0b-af31-d9a3803fb28f tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:09 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:49:09 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:09 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-e089b0f3-dd70-4b88-84bf-1f94634d983f req-4e1a2a79-1fc4-4a0b-af31-d9a3803fb28f tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-e089b0f3-dd70-4b88-84bf-1f94634d983f req-4e1a2a79-1fc4-4a0b-af31-d9a3803fb28f tempest-TestStampPattern-613059521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-e089b0f3-dd70-4b88-84bf-1f94634d983f req-4e1a2a79-1fc4-4a0b-af31-d9a3803fb28f tempest-TestStampPattern-613059521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-35b3999d-7853-40f2-b0e3-3228bbe71995', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb0ba18a-98a2-4461-b2cd-ef65147546c2', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:49:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-e089b0f3-dd70-4b88-84bf-1f94634d983f req-4e1a2a79-1fc4-4a0b-af31-d9a3803fb28f tempest-TestStampPattern-613059521 None] attachment_update completed successfully. Jul 09 16:49:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-b78ea930-8371-4a10-bf11-e57573dce106 req-5fd84cd3-40fb-49c6-b57a-806bba461496 tempest-TestStampPattern-613059521 None] Terminate volume connection completed successfully. Jul 09 16:49:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-b78ea930-8371-4a10-bf11-e57573dce106 req-5fd84cd3-40fb-49c6-b57a-806bba461496 tempest-TestStampPattern-613059521 None] Deleting attachment cb0ba18a-98a2-4461-b2cd-ef65147546c2. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:49:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:20 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Creating offline snapshot 310bcdb7-1056-4d56-817d-dbf34e1bb9c9 of volume 35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:49:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ded5ef-d602-4921-b5e1-99f139e5b79e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:20 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:49:20 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:21 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:21 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 1G Jul 09 16:49:21 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:21 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 1G" returned: 0 in 0.788s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b3999d-7853-40f2-b0e3-3228bbe71995 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:21 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b3999d-7853-40f2-b0e3-3228bbe71995 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 Jul 09 16:49:21 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:22 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35b3999d-7853-40f2-b0e3-3228bbe71995 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9" returned: 0 in 0.779s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:22 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 is being set with open permissions: ugo+rw Jul 09 16:49:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:22 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 Jul 09 16:49:22 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:23 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:23 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.info Jul 09 16:49:23 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:24 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.info" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:24 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.info is being set with open permissions: ugo+rw Jul 09 16:49:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:24 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.info Jul 09 16:49:24 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:24 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.info" returned: 0 in 0.647s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e3491a02-eec0-4c13-88bb-ee8778c1f296 tempest-TestStampPattern-613059521 None] Create snapshot completed successfully Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=55,cinder:UPDATE=59,cinder:DELETE=8,cinder:INSERT=23 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=68,cinder:SELECT=53,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:28 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:49:28 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:29 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.665s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:49:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:49:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:49:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Flow 'volume_create_manager' (b44a5f5a-2207-429a-9aab-910dc65896e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c79e37e-a7d0-49e1-984d-3a585024d0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c79e37e-a7d0-49e1-984d-3a585024d0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1885196790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9c268e-07de-4fbd-bdbc-8734410add8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c540d42a064a2eaf44dc14be87fcad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=310bcdb7-1056-4d56-817d-dbf34e1bb9c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:49:35Z,use_quota=True,user_id='33bc66afea124e30a8bfe3e1101afda8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c66e1d-8342-4f00-be2c-d29d98fa6149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c66e1d-8342-4f00-be2c-d29d98fa6149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8758eee4-5fb1-4073-a2ed-6613415fb187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8758eee4-5fb1-4073-a2ed-6613415fb187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af9c268e-07de-4fbd-bdbc-8734410add8a', 'volume_name': 'volume-af9c268e-07de-4fbd-bdbc-8734410add8a', 'volume_size': 1, 'snapshot_id': '310bcdb7-1056-4d56-817d-dbf34e1bb9c9'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0263f3-9d66-45fd-8c05-8831d7123ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0263f3-9d66-45fd-8c05-8831d7123ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d75bcf-41a9-48b3-b4d7-15d702de3930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Volume af9c268e-07de-4fbd-bdbc-8734410add8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af9c268e-07de-4fbd-bdbc-8734410add8a', 'volume_size': 1, 'snapshot_id': '310bcdb7-1056-4d56-817d-dbf34e1bb9c9'} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-quobyte-310bcdb7-1056-4d56-817d-dbf34e1bb9c9-af9c268e-07de-4fbd-bdbc-8734410add8a" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-310bcdb7-1056-4d56-817d-dbf34e1bb9c9-af9c268e-07de-4fbd-bdbc-8734410add8a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Creating volume af9c268e-07de-4fbd-bdbc-8734410add8a from snapshot 310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-quobyte-af9c268e-07de-4fbd-bdbc-8734410add8a" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-af9c268e-07de-4fbd-bdbc-8734410add8a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] snapshot: 310bcdb7-1056-4d56-817d-dbf34e1bb9c9, volume: af9c268e-07de-4fbd-bdbc-8734410add8a, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[43127dc9-21cb-46a0-bad4-2492a7b367a4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:35 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 Jul 09 16:49:35 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:35 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9" returned: 0 in 0.858s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b3999d-7853-40f2-b0e3-3228bbe71995(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:49:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:49:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:49:35 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[277a13c1-8d93-4d6a-ba7d-4f186a7dcc63]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:35 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:49:35 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:36 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 0.854s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:36 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:49:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:36 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a Jul 09 16:49:36 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Acquiring lock "cinder-0dd54674-19de-40da-b8c2-25519a8ef13a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Lock "cinder-0dd54674-19de-40da-b8c2-25519a8ef13a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Acquiring lock "cinder-quobyte-0dd54674-19de-40da-b8c2-25519a8ef13a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Lock "cinder-quobyte-0dd54674-19de-40da-b8c2-25519a8ef13a" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f1075-ae32-488f-8847-d9a8d0fbb881]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:37 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a Jul 09 16:49:37 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:38 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a" returned: 0 in 1.169s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:38 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a Jul 09 16:49:38 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:39 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0dd54674-19de-40da-b8c2-25519a8ef13a" returned: 0 in 1.229s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Lock "cinder-quobyte-0dd54674-19de-40da-b8c2-25519a8ef13a" released by "delete_volume" :: held 2.460s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Created reservations ['75a55b56-907b-470d-ba04-7fc039d93282', '35ecd3a2-a0ef-44ff-9e6c-84047c268f64', '883bf45d-8f12-4240-86d6-6282f265bcdb', 'bd1bb0b1-f501-43f6-95bd-8d9c109dc892'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:49:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:40 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:49:40 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:41 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:41 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:49:41 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Deleted volume successfully. Jul 09 16:49:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ae5be67d-359f-4460-aa7d-e744b15a6486 tempest-VolumesNegativeTest-971992995 None] Lock "cinder-0dd54674-19de-40da-b8c2-25519a8ef13a-delete_volume" released by "delete_volume" :: held 4.761s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:42 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a" returned: 0 in 5.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:42 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e346c-1f00-441a-a808-86049250218e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:42 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:49:42 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:43 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 1.288s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:43 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:49:43 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Converted 1024.00 MB image at 171.22 MB/s Jul 09 16:49:43 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a is being set with open permissions: ugo+rw Jul 09 16:49:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:44 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a Jul 09 16:49:44 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:44 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a" returned: 0 in 0.946s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-af9c268e-07de-4fbd-bdbc-8734410add8a" released by "_copy_volume_from_snapshot" :: held 10.054s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-310bcdb7-1056-4d56-817d-dbf34e1bb9c9-af9c268e-07de-4fbd-bdbc-8734410add8a" released by "_create_volume_from_snapshot" :: held 10.092s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.108s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0d75bcf-41a9-48b3-b4d7-15d702de3930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9c268e-07de-4fbd-bdbc-8734410add8a', 'volume_size': 1, 'snapshot_id': '310bcdb7-1056-4d56-817d-dbf34e1bb9c9'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f892f197-06a7-4f21-a061-739bbb55b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Volume volume-af9c268e-07de-4fbd-bdbc-8734410add8a (af9c268e-07de-4fbd-bdbc-8734410add8a): created successfully Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f892f197-06a7-4f21-a061-739bbb55b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Flow 'volume_create_manager' (b44a5f5a-2207-429a-9aab-910dc65896e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:49:45 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8e2f8c6a-6a3e-4c99-8f1e-056932282042 tempest-TestStampPattern-613059521 None] Created volume successfully. Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Flow 'volume_create_manager' (458cab73-7be1-43da-855c-59dbe399e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a06ae93-caec-44e7-be7b-bc1992d1f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a06ae93-caec-44e7-be7b-bc1992d1f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1042192044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7172a11-d530-4f17-a5cc-2fa4645150ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700d05fd770490abf36f6bd856520b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:49:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:49:46Z,use_quota=True,user_id='3b0667ad6ab74b1087c7b3997dcd45f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7905115-85d2-4e42-a07f-a64cb40a84c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7905115-85d2-4e42-a07f-a64cb40a84c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd81c012-00ca-4528-830b-7fd24de3980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd81c012-00ca-4528-830b-7fd24de3980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7172a11-d530-4f17-a5cc-2fa4645150ba', 'volume_name': 'volume-c7172a11-d530-4f17-a5cc-2fa4645150ba', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f64003-fa84-47fc-bcc1-bfc9a406feea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f64003-fa84-47fc-bcc1-bfc9a406feea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d90173-345c-4b69-a6ff-91dbebac5b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:45 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Volume c7172a11-d530-4f17-a5cc-2fa4645150ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7172a11-d530-4f17-a5cc-2fa4645150ba', 'volume_size': 2} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1042192044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7172a11-d530-4f17-a5cc-2fa4645150ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700d05fd770490abf36f6bd856520b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:49:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:49:46Z,use_quota=True,user_id='3b0667ad6ab74b1087c7b3997dcd45f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Creating volume c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:49:45 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:49:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba 2147483648 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:45 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba 2147483648 Jul 09 16:49:45 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:46 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba 2147483648" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:46 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba Jul 09 16:49:46 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:47 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba" returned: 0 in 0.637s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d90173-345c-4b69-a6ff-91dbebac5b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7172a11-d530-4f17-a5cc-2fa4645150ba', 'volume_size': 2}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86e1eed-dc09-4f08-8e17-ee22f69ccc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:49:47 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Volume volume-c7172a11-d530-4f17-a5cc-2fa4645150ba (c7172a11-d530-4f17-a5cc-2fa4645150ba): created successfully Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86e1eed-dc09-4f08-8e17-ee22f69ccc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Flow 'volume_create_manager' (458cab73-7be1-43da-855c-59dbe399e03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:49:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-25d4b075-8099-4f7f-9d69-88a41d8664df tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Created volume successfully. Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Creating offline snapshot 13595ef4-3b12-4c3e-8435-19cff14eea94 of volume c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:49:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c29518-42bf-4060-9e29-bf80abad5a3d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:48 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba Jul 09 16:49:48 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:48 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 2G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:48 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 2G Jul 09 16:49:48 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:49 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 2G" returned: 0 in 0.878s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7172a11-d530-4f17-a5cc-2fa4645150ba -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:49 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7172a11-d530-4f17-a5cc-2fa4645150ba -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 Jul 09 16:49:49 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:50 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7172a11-d530-4f17-a5cc-2fa4645150ba -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:50 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 is being set with open permissions: ugo+rw Jul 09 16:49:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:50 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 Jul 09 16:49:50 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:51 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:51 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.info Jul 09 16:49:51 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:51 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.info" returned: 0 in 0.674s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:51 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.info is being set with open permissions: ugo+rw Jul 09 16:49:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:51 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.info Jul 09 16:49:51 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:52 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.info" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.629s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d0f1f952-16c2-4617-92f2-89c2128dbafa tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Create snapshot completed successfully Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "cinder-13595ef4-3b12-4c3e-8435-19cff14eea94-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-13595ef4-3b12-4c3e-8435-19cff14eea94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "cinder-quobyte-c7172a11-d530-4f17-a5cc-2fa4645150ba" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-quobyte-c7172a11-d530-4f17-a5cc-2fa4645150ba" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "cinder-quobyte-13595ef4-3b12-4c3e-8435-19cff14eea94" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-quobyte-13595ef4-3b12-4c3e-8435-19cff14eea94" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Deleting offline snapshot 13595ef4-3b12-4c3e-8435-19cff14eea94 of volume c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] snapshot_file for this snap is: volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c052e-2d8a-4194-856a-1c9a20f31b80]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:53 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 Jul 09 16:49:53 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:54 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94" returned: 0 in 0.862s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7172a11-d530-4f17-a5cc-2fa4645150ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:49:54 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259fd06-2a22-47fe-b7a1-7cf40cd8b451]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:54 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba Jul 09 16:49:54 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:55 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:55 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 Jul 09 16:49:55 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:55 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94" returned: 0 in 0.773s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:55 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94 Jul 09 16:49:55 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:56 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba.13595ef4-3b12-4c3e-8435-19cff14eea94" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-quobyte-13595ef4-3b12-4c3e-8435-19cff14eea94" released by "_delete_snapshot" :: held 3.251s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-quobyte-c7172a11-d530-4f17-a5cc-2fa4645150ba" released by "delete_snapshot" :: held 3.278s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:56 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Created reservations ['4a09d210-6af8-418b-b116-c5ef09038d31', '4e6f4c53-192a-49e3-a5f1-52cd86f0f86b', '5e0cf0f2-68c7-462e-be42-cddddc26a42a', '4f0fd1ed-da23-4552-b9d3-1798d1625089'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:49:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Delete snapshot completed successfully. Jul 09 16:49:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6bbbea90-4eed-411c-800e-8ffafde01b9b tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-13595ef4-3b12-4c3e-8435-19cff14eea94-delete_snapshot" released by "delete_snapshot" :: held 3.427s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "cinder-c7172a11-d530-4f17-a5cc-2fa4645150ba-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-c7172a11-d530-4f17-a5cc-2fa4645150ba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "cinder-quobyte-c7172a11-d530-4f17-a5cc-2fa4645150ba" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:49:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-quobyte-c7172a11-d530-4f17-a5cc-2fa4645150ba" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:49:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[56744244-7061-4414-b2fc-115c0a343f68]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:49:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:57 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba Jul 09 16:49:57 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:58 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:58 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba Jul 09 16:49:58 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:49:59 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c7172a11-d530-4f17-a5cc-2fa4645150ba" returned: 0 in 0.679s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-quobyte-c7172a11-d530-4f17-a5cc-2fa4645150ba" released by "delete_volume" :: held 1.539s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Created reservations ['7e21253c-2763-45d9-a4ee-fb93d4837dd3', '214bd547-c8a7-4b1f-959a-c74f914cef07', 'fd1fa081-fbfa-4500-b6ff-2b42a586d690', 'b710e616-b62d-44c0-9c8b-3d023f4ba991'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:49:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:49:59 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:49:59 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:00 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.641s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:00 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Deleted volume successfully. Jul 09 16:50:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3757acdd-aa8c-4fb5-b4a7-62c0b18e7177 tempest-VolumesSnapshotNegativeTestJSON-1280931116 None] Lock "cinder-c7172a11-d530-4f17-a5cc-2fa4645150ba-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (f39e6dd6-f7dd-44ab-8d70-c9bd5deaa8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af180c0-79e2-4e06-8dc9-72f3ef601d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af180c0-79e2-4e06-8dc9-72f3ef601d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373570312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d21c8a-1aba-4115-9019-7d8c050414d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:03Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706ed10d-3f23-44ca-8650-6cf68500c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706ed10d-3f23-44ca-8650-6cf68500c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad21bea-5722-44d9-9edb-3c5c2c360a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad21bea-5722-44d9-9edb-3c5c2c360a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d21c8a-1aba-4115-9019-7d8c050414d1', 'volume_name': 'volume-13d21c8a-1aba-4115-9019-7d8c050414d1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7dba1ce-178d-4b1f-85f7-43e27a90922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7dba1ce-178d-4b1f-85f7-43e27a90922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8be4c16-23dc-4890-953e-0681cf8f1233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Volume 13d21c8a-1aba-4115-9019-7d8c050414d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d21c8a-1aba-4115-9019-7d8c050414d1', 'volume_size': 1} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373570312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d21c8a-1aba-4115-9019-7d8c050414d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:03Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Creating volume 13d21c8a-1aba-4115-9019-7d8c050414d1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:50:03 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:50:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:03 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 1073741824 Jul 09 16:50:03 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:04 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 1073741824" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:04 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 Jul 09 16:50:04 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:04 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1" returned: 0 in 0.646s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8be4c16-23dc-4890-953e-0681cf8f1233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d21c8a-1aba-4115-9019-7d8c050414d1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996918f8-1bbb-41f4-acd1-6a50d076baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Volume volume-13d21c8a-1aba-4115-9019-7d8c050414d1 (13d21c8a-1aba-4115-9019-7d8c050414d1): created successfully Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996918f8-1bbb-41f4-acd1-6a50d076baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (f39e6dd6-f7dd-44ab-8d70-c9bd5deaa8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-53635988-9d66-40ba-9f1e-1e3e42a1f890 tempest-ProjectReaderTests-1773793608 None] Created volume successfully. Jul 09 16:50:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-13d21c8a-1aba-4115-9019-7d8c050414d1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-13d21c8a-1aba-4115-9019-7d8c050414d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-quobyte-13d21c8a-1aba-4115-9019-7d8c050414d1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-13d21c8a-1aba-4115-9019-7d8c050414d1" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7a8e7-2266-4f48-916c-0a1f29ca3829]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:05 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 Jul 09 16:50:05 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:06 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1" returned: 0 in 0.749s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:06 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1 Jul 09 16:50:06 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:07 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-13d21c8a-1aba-4115-9019-7d8c050414d1" returned: 0 in 0.636s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-13d21c8a-1aba-4115-9019-7d8c050414d1" released by "delete_volume" :: held 1.425s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Created reservations ['320d5c49-d227-4799-8759-61fecbad8e6d', 'fc3b112d-ffde-4828-b5c7-d52b3a567527', 'e579e1d1-c442-4ff7-867e-da00dcf041f8', 'd4072842-dfb2-4d7d-9522-3796e2c06dd2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:07 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:50:07 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:07 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.656s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Deleted volume successfully. Jul 09 16:50:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-20e9228a-05e1-40e1-8277-6957884cfcd8 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-13d21c8a-1aba-4115-9019-7d8c050414d1-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (47bd4e4b-28e0-41c3-b36a-fba4b85a52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d76609e-63be-43d8-a169-255d7e985009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d76609e-63be-43d8-a169-255d7e985009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278634252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebabe20-8d00-47d4-8d15-dc7355873000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:08Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d58430-df09-4095-988d-996e7dd7a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d58430-df09-4095-988d-996e7dd7a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f648d408-d4a3-44b2-9444-e275db12227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f648d408-d4a3-44b2-9444-e275db12227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebabe20-8d00-47d4-8d15-dc7355873000', 'volume_name': 'volume-1ebabe20-8d00-47d4-8d15-dc7355873000', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c673ab4e-3e4a-4fc0-9618-a207bd13ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c673ab4e-3e4a-4fc0-9618-a207bd13ba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c772d63-2ed9-4b94-b02c-c25f7037faf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:08 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Volume 1ebabe20-8d00-47d4-8d15-dc7355873000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebabe20-8d00-47d4-8d15-dc7355873000', 'volume_size': 1} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278634252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebabe20-8d00-47d4-8d15-dc7355873000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:08Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Creating volume 1ebabe20-8d00-47d4-8d15-dc7355873000 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:50:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:50:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:08 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 1073741824 Jul 09 16:50:08 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:09 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 1073741824" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:09 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 Jul 09 16:50:09 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:09 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000" returned: 0 in 0.643s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c772d63-2ed9-4b94-b02c-c25f7037faf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebabe20-8d00-47d4-8d15-dc7355873000', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614f3aff-8a33-4725-996d-1d8d68e76bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Volume volume-1ebabe20-8d00-47d4-8d15-dc7355873000 (1ebabe20-8d00-47d4-8d15-dc7355873000): created successfully Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614f3aff-8a33-4725-996d-1d8d68e76bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (47bd4e4b-28e0-41c3-b36a-fba4b85a52ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6c26fde3-f5ee-4cc4-a481-869fec4d37f5 tempest-ProjectReaderTests-1773793608 None] Created volume successfully. Jul 09 16:50:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-1ebabe20-8d00-47d4-8d15-dc7355873000-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-1ebabe20-8d00-47d4-8d15-dc7355873000-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-quobyte-1ebabe20-8d00-47d4-8d15-dc7355873000" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-1ebabe20-8d00-47d4-8d15-dc7355873000" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd4426-c164-49b4-afd4-ec8ac13e09e8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:10 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 Jul 09 16:50:10 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:11 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:11 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000 Jul 09 16:50:11 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:11 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-1ebabe20-8d00-47d4-8d15-dc7355873000" returned: 0 in 0.661s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-1ebabe20-8d00-47d4-8d15-dc7355873000" released by "delete_volume" :: held 1.485s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Created reservations ['d62e6c54-423d-454e-9979-0971c97ac7f4', 'd38b9b3f-9e4f-4fcb-92da-e5c852c07b59', 'a5d95494-1059-4601-9a32-7913cee2cdf3', '518aa84d-7589-4ea0-abd9-0ad078010921'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:12 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:50:12 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:12 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.671s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:12 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Deleted volume successfully. Jul 09 16:50:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-12b8b933-b0c7-4481-8abb-d28a8b2e7cb4 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-1ebabe20-8d00-47d4-8d15-dc7355873000-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (b3e8a14e-30e2-4c2e-a6a8-1cd616948284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c780b0-7184-4ea9-b22e-ebd6a6d5824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c780b0-7184-4ea9-b22e-ebd6a6d5824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460370988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bc5f94-1346-4030-924a-d1caea636d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:13Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2ff56c-e4e2-4725-add5-0da9e41f3eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2ff56c-e4e2-4725-add5-0da9e41f3eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fc2727-514c-4090-8d7a-c07586b10713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fc2727-514c-4090-8d7a-c07586b10713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bc5f94-1346-4030-924a-d1caea636d21', 'volume_name': 'volume-93bc5f94-1346-4030-924a-d1caea636d21', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1522f527-b8d4-4d8b-9e7f-fa28a3ebc028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1522f527-b8d4-4d8b-9e7f-fa28a3ebc028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8978f64e-4f14-45fc-bbd2-de6175a2ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Volume 93bc5f94-1346-4030-924a-d1caea636d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bc5f94-1346-4030-924a-d1caea636d21', 'volume_size': 1} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460370988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bc5f94-1346-4030-924a-d1caea636d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:13Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Creating volume 93bc5f94-1346-4030-924a-d1caea636d21 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:50:13 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:13 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 1073741824 Jul 09 16:50:13 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:13 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 1073741824" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:14 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 Jul 09 16:50:14 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:14 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21" returned: 0 in 0.670s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:50:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8978f64e-4f14-45fc-bbd2-de6175a2ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bc5f94-1346-4030-924a-d1caea636d21', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb4cea9-4133-472e-b2b3-4ccf9e50970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:14 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Volume volume-93bc5f94-1346-4030-924a-d1caea636d21 (93bc5f94-1346-4030-924a-d1caea636d21): created successfully Jul 09 16:50:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb4cea9-4133-472e-b2b3-4ccf9e50970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:14 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (b3e8a14e-30e2-4c2e-a6a8-1cd616948284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:14 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e487ae3d-f612-4eca-b0f2-897d73b95407 tempest-ProjectReaderTests-1773793608 None] Created volume successfully. Jul 09 16:50:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-93bc5f94-1346-4030-924a-d1caea636d21-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Lock "cinder-93bc5f94-1346-4030-924a-d1caea636d21-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-quobyte-93bc5f94-1346-4030-924a-d1caea636d21" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-93bc5f94-1346-4030-924a-d1caea636d21" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5b851d-523c-46c4-bcfe-277b994f5850]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:15 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 Jul 09 16:50:15 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:16 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:16 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21 Jul 09 16:50:16 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:16 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-93bc5f94-1346-4030-924a-d1caea636d21" returned: 0 in 0.646s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-93bc5f94-1346-4030-924a-d1caea636d21" released by "delete_volume" :: held 1.443s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Created reservations ['d1b942e4-6a56-4a23-9e93-695126d8b494', '371b3345-abca-42c4-a020-88b6c88f9440', 'fca5117b-f8ce-4cb3-8371-de5be47b8ba5', '8bf89eb2-06db-46ac-972c-680e49e40edd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:16 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:50:16 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:17 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.673s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Deleted volume successfully. Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d6574de0-b941-4c63-bd36-0489a8c9b17f tempest-ProjectReaderTests-1773793608 None] Lock "cinder-93bc5f94-1346-4030-924a-d1caea636d21-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (2ed82f11-9bdf-4e3a-8563-afa294039d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91fde5f-d136-41a7-9dbb-fd4bb7711d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91fde5f-d136-41a7-9dbb-fd4bb7711d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922127740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fcb182-4480-4a4c-a276-c5a0f4a4ecd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:18Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a8a822-1ac0-4ecf-941e-bd860830f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a8a822-1ac0-4ecf-941e-bd860830f39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11969a4f-cc1d-43e6-9071-87c89c14e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11969a4f-cc1d-43e6-9071-87c89c14e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03fcb182-4480-4a4c-a276-c5a0f4a4ecd0', 'volume_name': 'volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2474f0d3-bae9-4478-82b5-b407eb9bdd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2474f0d3-bae9-4478-82b5-b407eb9bdd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f39543-e081-475f-b4ad-053fbb9aed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Volume 03fcb182-4480-4a4c-a276-c5a0f4a4ecd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0', 'volume_size': 1} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922127740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fcb182-4480-4a4c-a276-c5a0f4a4ecd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222740161adb481ea5cb8bf3a6920dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:50:18Z,use_quota=True,user_id='be56c2225ad74961b326e9a5387451b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Creating volume 03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:50:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:50:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:17 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 1073741824 Jul 09 16:50:17 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:18 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 1073741824" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:18 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 Jul 09 16:50:18 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:19 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f39543-e081-475f-b4ad-053fbb9aed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96166f1-cb9d-422c-9714-ed069ec6f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:50:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Volume volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 (03fcb182-4480-4a4c-a276-c5a0f4a4ecd0): created successfully Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96166f1-cb9d-422c-9714-ed069ec6f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Flow 'volume_create_manager' (2ed82f11-9bdf-4e3a-8563-afa294039d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:50:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1a12151d-7484-43a5-b606-cb685d444f05 tempest-ProjectReaderTests-1773793608 None] Created volume successfully. Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "cinder-quobyte-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09fae8-8ecb-4ade-ad23-3cc485d8c6bf]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-9252eec7-6f94-4082-854b-6b817782aa24 req-4cd7bdff-d652-49c9-9862-ff64c3a606bd tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-9252eec7-6f94-4082-854b-6b817782aa24 req-4cd7bdff-d652-49c9-9862-ff64c3a606bd tempest-TestStampPattern-613059521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6770ff-6b00-43f2-b26a-5121e792b873]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:20 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 Jul 09 16:50:20 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-9252eec7-6f94-4082-854b-6b817782aa24 req-4cd7bdff-d652-49c9-9862-ff64c3a606bd tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:20 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a Jul 09 16:50:20 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:20 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0" returned: 0 in 0.786s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:20 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0 Jul 09 16:50:20 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:20 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [req-9252eec7-6f94-4082-854b-6b817782aa24 req-4cd7bdff-d652-49c9-9862-ff64c3a606bd tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [req-9252eec7-6f94-4082-854b-6b817782aa24 req-4cd7bdff-d652-49c9-9862-ff64c3a606bd tempest-TestStampPattern-613059521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.782s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-9252eec7-6f94-4082-854b-6b817782aa24 req-4cd7bdff-d652-49c9-9862-ff64c3a606bd tempest-TestStampPattern-613059521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31', 'name': 'volume-af9c268e-07de-4fbd-bdbc-8734410add8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '419eb0f8-2f7d-4c51-87e2-792679e78057', 'enforce_multipath': True} {{(pid=87204) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 16:50:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-9252eec7-6f94-4082-854b-6b817782aa24 req-4cd7bdff-d652-49c9-9862-ff64c3a606bd tempest-TestStampPattern-613059521 None] attachment_update completed successfully. Jul 09 16:50:21 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0" returned: 0 in 0.658s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-quobyte-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0" released by "delete_volume" :: held 1.488s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Created reservations ['c123de8f-54df-4c65-8dc0-eda52162a6ef', '7c666fa2-ce74-46d5-ae64-8977794c2b52', 'b851f780-6ffa-4214-8b90-a82a2d5569b4', 'cabbb6bb-11ec-45be-b506-4852c35f9cca'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:21 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:50:21 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:22 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.679s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:22 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Deleted volume successfully. Jul 09 16:50:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b44ed9ed-ac5e-4277-a9c0-0915386c17c2 tempest-ProjectReaderTests-1773793608 None] Lock "cinder-03fcb182-4480-4a4c-a276-c5a0f4a4ecd0-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:27 devstack cinder-volume[87204]: INFO cinder.volume.manager [req-12f6b403-12b2-406b-885c-0180fe248c19 req-2732e0e6-1bd3-4af3-b341-9a800394eca2 tempest-TestStampPattern-613059521 None] Terminate volume connection completed successfully. Jul 09 16:50:27 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [req-12f6b403-12b2-406b-885c-0180fe248c19 req-2732e0e6-1bd3-4af3-b341-9a800394eca2 tempest-TestStampPattern-613059521 None] Deleting attachment 419eb0f8-2f7d-4c51-87e2-792679e78057. {{(pid=87204) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 16:50:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:50:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:28 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:50:28 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:29 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.674s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:50:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:50:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:50:31 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=79,cinder:SELECT=59,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:50:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-af9c268e-07de-4fbd-bdbc-8734410add8a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Lock "cinder-af9c268e-07de-4fbd-bdbc-8734410add8a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:37 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=57,cinder:UPDATE=69,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:50:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-quobyte-af9c268e-07de-4fbd-bdbc-8734410add8a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-af9c268e-07de-4fbd-bdbc-8734410add8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[312a2481-0e63-4427-b00e-3088532fc9fc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:37 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a Jul 09 16:50:37 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:38 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a" returned: 0 in 0.734s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:38 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a Jul 09 16:50:38 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:38 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-af9c268e-07de-4fbd-bdbc-8734410add8a" returned: 0 in 0.626s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-af9c268e-07de-4fbd-bdbc-8734410add8a" released by "delete_volume" :: held 1.397s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Created reservations ['48ce2ceb-cf3a-4283-9376-4962df2f2fc6', '8b4e9630-dd11-474c-8c00-6f0279137924', '262201d0-301e-4aa3-b262-ae985fc61f93', 'f977febf-6b52-4775-b10c-cbdd6a873b30'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:38 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:50:38 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:39 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.639s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Deleted volume successfully. Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-474120f1-5c93-4b20-97d2-b073f3ebb214 tempest-TestStampPattern-613059521 None] Lock "cinder-af9c268e-07de-4fbd-bdbc-8734410add8a-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-310bcdb7-1056-4d56-817d-dbf34e1bb9c9-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Lock "cinder-310bcdb7-1056-4d56-817d-dbf34e1bb9c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-quobyte-35b3999d-7853-40f2-b0e3-3228bbe71995" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-35b3999d-7853-40f2-b0e3-3228bbe71995" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-quobyte-310bcdb7-1056-4d56-817d-dbf34e1bb9c9" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-310bcdb7-1056-4d56-817d-dbf34e1bb9c9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Deleting offline snapshot 310bcdb7-1056-4d56-817d-dbf34e1bb9c9 of volume 35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] snapshot_file for this snap is: volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[596ebe1a-68a8-485f-9d90-846fbc6011cc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:39 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 Jul 09 16:50:39 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:40 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35b3999d-7853-40f2-b0e3-3228bbe71995(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:50:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[54950d55-c672-4748-b6d4-a551a1276e61]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:40 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:50:40 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:41 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 0.724s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:41 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 Jul 09 16:50:41 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:41 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9" returned: 0 in 0.724s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:41 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9 Jul 09 16:50:41 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:42 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995.310bcdb7-1056-4d56-817d-dbf34e1bb9c9" returned: 0 in 0.655s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-310bcdb7-1056-4d56-817d-dbf34e1bb9c9" released by "_delete_snapshot" :: held 2.932s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-35b3999d-7853-40f2-b0e3-3228bbe71995" released by "delete_snapshot" :: held 2.954s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:42 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Created reservations ['55614e0c-48ec-4ddd-906d-1188e96add14', 'ccb71bd2-9d62-4e23-907c-23f67c089c36', '82faea84-9c7f-4010-8420-81434fe8391f', '6a589ba4-52da-473c-bdab-c546ae4c754a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:50:42 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Delete snapshot completed successfully. Jul 09 16:50:42 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-cd353a2b-aa4e-4b80-9721-719d19f23f31 tempest-TestStampPattern-613059521 None] Lock "cinder-310bcdb7-1056-4d56-817d-dbf34e1bb9c9-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-35b3999d-7853-40f2-b0e3-3228bbe71995-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Lock "cinder-35b3999d-7853-40f2-b0e3-3228bbe71995-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Acquiring lock "cinder-quobyte-35b3999d-7853-40f2-b0e3-3228bbe71995" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:50:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-35b3999d-7853-40f2-b0e3-3228bbe71995" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:50:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb77561-650b-4f53-848f-f1b27eda9062]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:50:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:51 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:50:51 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:51 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 0.755s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:51 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995 Jul 09 16:50:51 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:52 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35b3999d-7853-40f2-b0e3-3228bbe71995" returned: 0 in 0.641s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Lock "cinder-quobyte-35b3999d-7853-40f2-b0e3-3228bbe71995" released by "delete_volume" :: held 1.459s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Created reservations ['866c27ee-a6b3-4f04-a5c1-469ae929b0bb', '877af72c-8254-41ae-8506-bf3b88021414', '59d1d53a-f45c-403e-88aa-ea2da8dbdd51', 'd99a061d-1ad7-4ee3-a421-89474eb2a263'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:50:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:50:52 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:50:52 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:50:53 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 09 16:50:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.644s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:50:53 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:50:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Deleted volume successfully. Jul 09 16:50:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d3d3f789-061a-42d6-aad6-a98bd3e8e5f6 tempest-TestStampPattern-613059521 None] Lock "cinder-35b3999d-7853-40f2-b0e3-3228bbe71995-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Flow 'volume_create_manager' (603b5ece-2ae7-4435-a927-9a79989f06d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede93099-e58c-4e52-9f0e-f9fca8f0c23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede93099-e58c-4e52-9f0e-f9fca8f0c23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b96c51d774c4daedc48cc080929a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:03Z,use_quota=True,user_id='1c117fa75ccb4f2e82e428a786e372ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aab3259-4051-4f64-93a4-daa74b0d21ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aab3259-4051-4f64-93a4-daa74b0d21ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105c8f19-b796-46c7-829a-5fbfca17abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105c8f19-b796-46c7-829a-5fbfca17abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d', 'volume_name': 'volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8eeb49-2b0c-470e-9d10-65f0fd2725b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8eeb49-2b0c-470e-9d10-65f0fd2725b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3255a524-601b-4b74-b291-cd122d23c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Volume 0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d', 'volume_size': 1} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b96c51d774c4daedc48cc080929a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:03Z,use_quota=True,user_id='1c117fa75ccb4f2e82e428a786e372ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Creating volume 0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:03 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d 1073741824 Jul 09 16:51:03 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:03 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d 1073741824" returned: 0 in 0.813s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:03 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d Jul 09 16:51:03 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:04 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3255a524-601b-4b74-b291-cd122d23c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826fa6d6-a0c6-4355-9f21-5abd682246fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:04 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Volume volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d (0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d): created successfully Jul 09 16:51:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826fa6d6-a0c6-4355-9f21-5abd682246fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:04 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Flow 'volume_create_manager' (603b5ece-2ae7-4435-a927-9a79989f06d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-1808d49e-bed0-4f24-baa4-bd15555505aa tempest-CinderUnicodeTest-727388446 None] Created volume successfully. Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Flow 'volume_create_manager' (eac54c19-78b4-4b9f-8511-88c942d5d3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa22894d-f993-4505-92b0-2da81359f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa22894d-f993-4505-92b0-2da81359f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1874009873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4442ea51-3ffa-46c7-8142-e22a48fcd1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b96c51d774c4daedc48cc080929a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:05Z,use_quota=True,user_id='1c117fa75ccb4f2e82e428a786e372ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748a3fa4-c68f-4f1e-8525-ad770f9e0d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748a3fa4-c68f-4f1e-8525-ad770f9e0d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f1d53a-8fac-46ee-8929-ecec445520b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f1d53a-8fac-46ee-8929-ecec445520b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4442ea51-3ffa-46c7-8142-e22a48fcd1ee', 'volume_name': 'volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99b6880-79e9-4810-af24-9761f68e3491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99b6880-79e9-4810-af24-9761f68e3491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c77b5f-aca5-4ce1-b8c4-c9669a296bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Volume 4442ea51-3ffa-46c7-8142-e22a48fcd1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee', 'volume_size': 1} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1874009873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4442ea51-3ffa-46c7-8142-e22a48fcd1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b96c51d774c4daedc48cc080929a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:05Z,use_quota=True,user_id='1c117fa75ccb4f2e82e428a786e372ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Creating volume 4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:05 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:05 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee 1073741824 Jul 09 16:51:05 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:06 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee 1073741824" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:06 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee Jul 09 16:51:06 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:07 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c77b5f-aca5-4ce1-b8c4-c9669a296bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f571ade-1fa1-40e5-9695-91ee479e662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Volume volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee (4442ea51-3ffa-46c7-8142-e22a48fcd1ee): created successfully Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f571ade-1fa1-40e5-9695-91ee479e662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Flow 'volume_create_manager' (eac54c19-78b4-4b9f-8511-88c942d5d3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-527901c4-4681-4f1d-b88a-e1aa05b357bc tempest-CinderUnicodeTest-727388446 None] Created volume successfully. Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Creating offline snapshot 13aa6cef-2ee5-4814-a846-8f0405180fbe of volume 4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9fdc67-585b-4303-a21a-648180c8333c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:07 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee Jul 09 16:51:07 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:08 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" returned: 0 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:08 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe 1G Jul 09 16:51:08 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:09 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe 1G" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:09 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe Jul 09 16:51:09 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:09 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe" returned: 0 in 0.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:09 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe is being set with open permissions: ugo+rw Jul 09 16:51:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:10 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe Jul 09 16:51:10 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:10 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe" returned: 0 in 0.629s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:10 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.info Jul 09 16:51:10 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:11 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.info" returned: 0 in 0.657s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:11 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.info is being set with open permissions: ugo+rw Jul 09 16:51:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:11 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.info Jul 09 16:51:11 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:11 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.info" returned: 0 in 0.621s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.224s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c6fa7ff2-bbe1-4d0c-9c25-9887d6d0fd91 tempest-CinderUnicodeTest-727388446 None] Create snapshot completed successfully Jul 09 16:51:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Acquiring lock "cinder-13aa6cef-2ee5-4814-a846-8f0405180fbe-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-13aa6cef-2ee5-4814-a846-8f0405180fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Acquiring lock "cinder-quobyte-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Acquiring lock "cinder-quobyte-13aa6cef-2ee5-4814-a846-8f0405180fbe" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-13aa6cef-2ee5-4814-a846-8f0405180fbe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Deleting offline snapshot 13aa6cef-2ee5-4814-a846-8f0405180fbe of volume 4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] snapshot_file for this snap is: volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b289698-1e12-4b39-bb36-0d2e2aba5448]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:13 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe Jul 09 16:51:13 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:13 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe" returned: 0 in 0.744s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f94fc-d551-4b35-a906-053f3efecb8f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:13 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee Jul 09 16:51:13 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:14 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" returned: 0 in 0.730s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:14 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe Jul 09 16:51:14 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:15 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:15 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe Jul 09 16:51:15 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:15 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee.13aa6cef-2ee5-4814-a846-8f0405180fbe" returned: 0 in 0.639s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-13aa6cef-2ee5-4814-a846-8f0405180fbe" released by "_delete_snapshot" :: held 2.945s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" released by "delete_snapshot" :: held 2.970s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Created reservations ['66b8990d-946a-4092-a2fe-61f8f84b445f', '2ef8d9ef-067c-4162-abbd-7efc84958c07', 'db8a7460-dbc0-474e-8ab8-2f6b1f8ead39', '4ebff5fd-a8dd-4dfa-8d16-d81fc6759bcc'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:51:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Delete snapshot completed successfully. Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-34f72a92-44cd-4e4e-894a-06e9fca944f5 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-13aa6cef-2ee5-4814-a846-8f0405180fbe-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Acquiring lock "cinder-4442ea51-3ffa-46c7-8142-e22a48fcd1ee-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-4442ea51-3ffa-46c7-8142-e22a48fcd1ee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Acquiring lock "cinder-quobyte-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[390079a7-3cdb-4036-8855-a08db3332aad]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:16 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee Jul 09 16:51:16 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:16 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:16 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee Jul 09 16:51:16 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:17 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" returned: 0 in 0.629s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-4442ea51-3ffa-46c7-8142-e22a48fcd1ee" released by "delete_volume" :: held 1.410s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Created reservations ['952ddf15-f8a3-4eb0-baf3-0c2e14971839', '2607850a-597d-40ad-84d0-8f4c31529ef9', '26737ee3-9121-4468-965e-005c41eeaccf', '982afebd-ae26-47ce-8132-a18cb463a96a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:17 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:51:17 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Acquiring lock "cinder-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Lock "cinder-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:18 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Acquiring lock "cinder-quobyte-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:51:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Deleted volume successfully. Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-eb52c27d-7d5f-4e89-bc45-4e0e40817ba6 tempest-CinderUnicodeTest-727388446 None] Lock "cinder-4442ea51-3ffa-46c7-8142-e22a48fcd1ee-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383462c-8d16-49cc-9947-77703021b355]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:18 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d Jul 09 16:51:18 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:19 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d" returned: 0 in 0.757s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:19 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d Jul 09 16:51:19 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:19 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Lock "cinder-quobyte-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d" released by "delete_volume" :: held 1.454s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Created reservations ['1202e91b-ad61-49fe-982b-cee1fdac329d', '352d3ef1-1e9a-4ab8-af21-078f16606984', 'e2dc33bc-5373-4be6-83f7-a7d77a9da71b', '40acd31f-6e79-4f4b-ae87-fcbd247f3988'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:20 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:51:20 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:20 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.628s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:20 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:51:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Deleted volume successfully. Jul 09 16:51:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8d6f9326-6042-4922-8bf6-fa2d232f7bbc tempest-CinderUnicodeTest-727388446 None] Lock "cinder-0b502f3a-9d68-4bf8-8c1d-2a89f9009a4d-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Flow 'volume_create_manager' (4072d146-ac6f-4c7a-9ee4-e66f0006f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89f1c82-0250-40ba-8169-ca851709995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89f1c82-0250-40ba-8169-ca851709995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1285800235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc8c5a6-2180-473b-9f64-277ee953b035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde5d623fff4315b7dda79412c1ed46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:24Z,use_quota=True,user_id='0327371d56284919859e40b509597b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e42ec7-2a3a-4c81-b870-7fd7226b08ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e42ec7-2a3a-4c81-b870-7fd7226b08ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecee02f-a614-4cb0-a333-11679509aff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecee02f-a614-4cb0-a333-11679509aff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc8c5a6-2180-473b-9f64-277ee953b035', 'volume_name': 'volume-4cc8c5a6-2180-473b-9f64-277ee953b035', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b4b8eb-529b-474d-ac54-67b37b5c48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b4b8eb-529b-474d-ac54-67b37b5c48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3acf661-ec8d-4e1d-a518-c73f5cd491e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Volume 4cc8c5a6-2180-473b-9f64-277ee953b035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc8c5a6-2180-473b-9f64-277ee953b035', 'volume_size': 1} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1285800235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc8c5a6-2180-473b-9f64-277ee953b035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde5d623fff4315b7dda79412c1ed46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:24Z,use_quota=True,user_id='0327371d56284919859e40b509597b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Creating volume 4cc8c5a6-2180-473b-9f64-277ee953b035 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:23 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:23 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 1073741824 Jul 09 16:51:23 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:24 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 1073741824" returned: 0 in 0.809s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:24 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 Jul 09 16:51:24 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:25 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035" returned: 0 in 0.667s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3acf661-ec8d-4e1d-a518-c73f5cd491e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc8c5a6-2180-473b-9f64-277ee953b035', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d09970-af46-4e48-9871-813655b8c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Volume volume-4cc8c5a6-2180-473b-9f64-277ee953b035 (4cc8c5a6-2180-473b-9f64-277ee953b035): created successfully Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d09970-af46-4e48-9871-813655b8c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Flow 'volume_create_manager' (4072d146-ac6f-4c7a-9ee4-e66f0006f053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2d3872de-2034-4a58-8bda-c9c52566b301 tempest-ProjectReaderTests-245886099 None] Created volume successfully. Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Acquiring lock "cinder-4cc8c5a6-2180-473b-9f64-277ee953b035-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Lock "cinder-4cc8c5a6-2180-473b-9f64-277ee953b035-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Acquiring lock "cinder-quobyte-4cc8c5a6-2180-473b-9f64-277ee953b035" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Lock "cinder-quobyte-4cc8c5a6-2180-473b-9f64-277ee953b035" acquired by "delete_volume" :: waited 0.012s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:26 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[992acc2e-8d89-4b7b-afdd-82e0cb85583e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:26 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 Jul 09 16:51:26 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:26 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035" returned: 0 in 0.748s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:26 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035 Jul 09 16:51:26 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:27 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-4cc8c5a6-2180-473b-9f64-277ee953b035" returned: 0 in 0.629s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Lock "cinder-quobyte-4cc8c5a6-2180-473b-9f64-277ee953b035" released by "delete_volume" :: held 1.412s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Created reservations ['7145815f-f521-4d19-b17a-313cc32f5b17', '8c25a1ad-0db3-4bd9-bae0-11e06848c420', 'c4e4bb50-83a1-4113-b643-091e31fe441d', '90b470e1-2d19-4879-a78b-b9612f9f0df0'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:27 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:51:27 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:28 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.638s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:51:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Deleted volume successfully. Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b1d18262-1159-48ae-8fac-bbc5bf8c1dc9 tempest-ProjectReaderTests-245886099 None] Lock "cinder-4cc8c5a6-2180-473b-9f64-277ee953b035-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Flow 'volume_create_manager' (58776f55-b27c-46d1-9451-b297240003b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892505f0-0b72-4565-9741-aa059e6562a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892505f0-0b72-4565-9741-aa059e6562a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187252671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ba8486-f6f1-46f4-9c1b-1dacd576ddc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde5d623fff4315b7dda79412c1ed46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:29Z,use_quota=True,user_id='0327371d56284919859e40b509597b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87501985-29d8-4540-9430-2167b52021d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87501985-29d8-4540-9430-2167b52021d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072637dc-3071-4fb6-8c27-f0b9b4881a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072637dc-3071-4fb6-8c27-f0b9b4881a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ba8486-f6f1-46f4-9c1b-1dacd576ddc1', 'volume_name': 'volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7934f428-7635-44e8-8c77-f5ebf99a6530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7934f428-7635-44e8-8c77-f5ebf99a6530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddb3c86-8d20-4b84-ab52-90793a8ea0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:28 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Volume 43ba8486-f6f1-46f4-9c1b-1dacd576ddc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1', 'volume_size': 1} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187252671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ba8486-f6f1-46f4-9c1b-1dacd576ddc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efde5d623fff4315b7dda79412c1ed46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:29Z,use_quota=True,user_id='0327371d56284919859e40b509597b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Creating volume 43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:28 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:28 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 1073741824 Jul 09 16:51:28 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:28 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:51:28 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:29 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.642s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:51:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:51:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:51:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:51:29 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 1073741824" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:29 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 Jul 09 16:51:29 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:30 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1" returned: 0 in 0.623s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddb3c86-8d20-4b84-ab52-90793a8ea0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6783eb8b-845f-4052-8f92-6fd43c5c546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Volume volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 (43ba8486-f6f1-46f4-9c1b-1dacd576ddc1): created successfully Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6783eb8b-845f-4052-8f92-6fd43c5c546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Flow 'volume_create_manager' (58776f55-b27c-46d1-9451-b297240003b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:30 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e6bc3dd7-a13b-44b9-a4da-aaa618a480b3 tempest-ProjectReaderTests-245886099 None] Created volume successfully. Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Acquiring lock "cinder-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Lock "cinder-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Acquiring lock "cinder-quobyte-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Lock "cinder-quobyte-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b652f6a-e5e1-4b29-8748-ddd210bf30fb]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:30 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 Jul 09 16:51:30 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:31 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:31 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1 Jul 09 16:51:31 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:32 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Lock "cinder-quobyte-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1" released by "delete_volume" :: held 1.435s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Created reservations ['92c939de-b264-4bdd-be4a-e62e51130bf1', 'ae2b691c-5ad7-41f0-b3dc-93efe6208fdb', '47de1228-a2c6-4dab-9d02-215cdd90f64d', '2397763b-b419-40be-912d-c3ca85cb96c1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:32 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:51:32 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:32 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.638s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:51:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Deleted volume successfully. Jul 09 16:51:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e1315522-b877-487e-ac24-77a6f64a31db tempest-ProjectReaderTests-245886099 None] Lock "cinder-43ba8486-f6f1-46f4-9c1b-1dacd576ddc1-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:51:42 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=59,cinder:INSERT=17,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:51:42 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=32,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (4769897b-7797-48fa-b812-aef8cfeb1c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7fa4f4-d143-41f2-9cb5-d1fbfed744c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7fa4f4-d143-41f2-9cb5-d1fbfed744c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824448766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef31ae7-f743-47b8-9330-a33e21f37600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:49Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb7688-6023-4423-b3dd-af94df67d714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb7688-6023-4423-b3dd-af94df67d714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61074eb4-3288-4474-8908-67143ffe3bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61074eb4-3288-4474-8908-67143ffe3bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef31ae7-f743-47b8-9330-a33e21f37600', 'volume_name': 'volume-8ef31ae7-f743-47b8-9330-a33e21f37600', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93236698-48cc-4cb2-b4e8-5688cd898866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93236698-48cc-4cb2-b4e8-5688cd898866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae711c5-d122-44ab-8a61-471546bc2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume 8ef31ae7-f743-47b8-9330-a33e21f37600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef31ae7-f743-47b8-9330-a33e21f37600', 'volume_size': 1} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824448766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef31ae7-f743-47b8-9330-a33e21f37600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:49Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Creating volume 8ef31ae7-f743-47b8-9330-a33e21f37600 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:49 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 1073741824 Jul 09 16:51:49 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (9c69b98d-71b5-4630-9392-62ed86453ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c60c940-6e36-4cdc-82f0-d87616977895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c60c940-6e36-4cdc-82f0-d87616977895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050000091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2473accb-6c59-420a-95ee-b4108ad5d38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:49Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891e0941-38ba-4e1d-841a-89ede50ea19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891e0941-38ba-4e1d-841a-89ede50ea19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318b449d-fb3b-47b1-b074-d9ae4f686985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318b449d-fb3b-47b1-b074-d9ae4f686985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2473accb-6c59-420a-95ee-b4108ad5d38e', 'volume_name': 'volume-2473accb-6c59-420a-95ee-b4108ad5d38e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3beacee-10ff-4470-adac-aab24e0d25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3beacee-10ff-4470-adac-aab24e0d25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7571ea4a-f644-46d3-b970-c5e797a490af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume 2473accb-6c59-420a-95ee-b4108ad5d38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2473accb-6c59-420a-95ee-b4108ad5d38e', 'volume_size': 1} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (65720d61-714a-48b7-920f-328bb4751e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21b7c62-26da-4b5d-8716-2a8c1f17ce46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21b7c62-26da-4b5d-8716-2a8c1f17ce46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975161527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04f324f-6cb8-442f-bb90-b471743906f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:49Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6507b49-2078-4de5-955d-742b1ab53741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6507b49-2078-4de5-955d-742b1ab53741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734e7a66-7f60-4799-a2f1-5a9a05c1f0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734e7a66-7f60-4799-a2f1-5a9a05c1f0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04f324f-6cb8-442f-bb90-b471743906f3', 'volume_name': 'volume-c04f324f-6cb8-442f-bb90-b471743906f3', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a92351-0191-47f2-8dbe-1b1fb9237253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a92351-0191-47f2-8dbe-1b1fb9237253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff0ff35-a5eb-4023-a6e5-13cbbacb4478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Volume c04f324f-6cb8-442f-bb90-b471743906f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04f324f-6cb8-442f-bb90-b471743906f3', 'volume_size': 1} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (d0059b56-95ee-4bcf-b6a7-b17c5038a6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c82076b-978c-4583-a49b-a955559f1b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c82076b-978c-4583-a49b-a955559f1b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-993158180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d936224-e839-4660-aa29-28f952519cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:50Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91844e29-7ed6-44e7-9172-b6da72c4d6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91844e29-7ed6-44e7-9172-b6da72c4d6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17658895-cafc-4869-a7c9-d2bf3b218632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17658895-cafc-4869-a7c9-d2bf3b218632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d936224-e839-4660-aa29-28f952519cd5', 'volume_name': 'volume-2d936224-e839-4660-aa29-28f952519cd5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e0a2cb-cdd1-4daa-a8c8-09855a9f14e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e0a2cb-cdd1-4daa-a8c8-09855a9f14e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c735eeac-4cae-42f6-8ebc-a6635bc0ecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Volume 2d936224-e839-4660-aa29-28f952519cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d936224-e839-4660-aa29-28f952519cd5', 'volume_size': 1} Jul 09 16:51:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:50 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 1073741824" returned: 0 in 1.052s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:50 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 Jul 09 16:51:50 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (ccb00a13-f299-4448-b645-08d1a101c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6863dd27-dc25-40fe-b77a-e7cdf656b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6863dd27-dc25-40fe-b77a-e7cdf656b722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1944511027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbe2ad1-a072-4963-a175-418b05157f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:50Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e1c192-e4fb-4ce0-aeb4-2be3ed3a0723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e1c192-e4fb-4ce0-aeb4-2be3ed3a0723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154186d8-c885-4dc2-b2f1-d85034657e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154186d8-c885-4dc2-b2f1-d85034657e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acbe2ad1-a072-4963-a175-418b05157f5d', 'volume_name': 'volume-acbe2ad1-a072-4963-a175-418b05157f5d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa4e59d-cc5d-45ca-af87-4bc30ead09d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa4e59d-cc5d-45ca-af87-4bc30ead09d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b614ee5f-b967-45c2-9dde-aebd72379956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Volume acbe2ad1-a072-4963-a175-418b05157f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acbe2ad1-a072-4963-a175-418b05157f5d', 'volume_size': 1} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (25617be0-5717-4b5f-a74a-fb96a2aadb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4109dfda-cc32-4917-8aee-869f51757885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4109dfda-cc32-4917-8aee-869f51757885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-586445305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33832cf8-994e-4d07-866c-3331581cfa02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:50Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbad2489-10fe-472d-abe7-35bb2ebcc806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbad2489-10fe-472d-abe7-35bb2ebcc806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d206a78-27df-40b3-8d8d-9e2d2654a14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d206a78-27df-40b3-8d8d-9e2d2654a14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33832cf8-994e-4d07-866c-3331581cfa02', 'volume_name': 'volume-33832cf8-994e-4d07-866c-3331581cfa02', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7d2881-39fb-43c4-adf4-0918f0ad6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7d2881-39fb-43c4-adf4-0918f0ad6858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd75e01-0700-4505-b436-605f621097bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Volume 33832cf8-994e-4d07-866c-3331581cfa02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33832cf8-994e-4d07-866c-3331581cfa02', 'volume_size': 1} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:50 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050000091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2473accb-6c59-420a-95ee-b4108ad5d38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:49Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Creating volume 2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:50 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae711c5-d122-44ab-8a61-471546bc2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef31ae7-f743-47b8-9330-a33e21f37600', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0ddc49-7436-4506-8cd1-d5863e1e5ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:50 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e 1073741824 Jul 09 16:51:50 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume volume-8ef31ae7-f743-47b8-9330-a33e21f37600 (8ef31ae7-f743-47b8-9330-a33e21f37600): created successfully Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0ddc49-7436-4506-8cd1-d5863e1e5ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (4769897b-7797-48fa-b812-aef8cfeb1c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f869d639-e9b0-4442-a330-8fe0eecf699f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created volume successfully. Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (65a57f70-dd81-455f-a304-a0c75882ab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c1ae02-db64-48c0-a0b4-7c79d84f6588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c1ae02-db64-48c0-a0b4-7c79d84f6588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1639144806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d122fc-f156-4dda-b978-7041d5ad73e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:51Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3e0dc7-4a4b-4798-bdd3-803db9726979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3e0dc7-4a4b-4798-bdd3-803db9726979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40019c75-e545-48bb-b341-bd63a087916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40019c75-e545-48bb-b341-bd63a087916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d122fc-f156-4dda-b978-7041d5ad73e2', 'volume_name': 'volume-e9d122fc-f156-4dda-b978-7041d5ad73e2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e901eae-3371-4e8d-96c6-11966521d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e901eae-3371-4e8d-96c6-11966521d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62bde57-ae79-4749-ab82-ad2e5e1442dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Volume e9d122fc-f156-4dda-b978-7041d5ad73e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d122fc-f156-4dda-b978-7041d5ad73e2', 'volume_size': 1} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:51 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e 1073741824" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:51 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e Jul 09 16:51:51 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (c206f4f5-af82-41cc-8f00-d435760a1895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ee9828-223a-4af3-80ae-81592613ea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ee9828-223a-4af3-80ae-81592613ea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986634362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c38903-1498-471d-bb2c-5e2a3c73c319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:52Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7ce1d2-bee0-46e4-863e-4d2b3aeab6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7ce1d2-bee0-46e4-863e-4d2b3aeab6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a315b1c4-9fa2-4517-9a86-738601fe38d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a315b1c4-9fa2-4517-9a86-738601fe38d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c38903-1498-471d-bb2c-5e2a3c73c319', 'volume_name': 'volume-a2c38903-1498-471d-bb2c-5e2a3c73c319', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3cea75-5fb9-422a-bb7d-617fda2ad8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3cea75-5fb9-422a-bb7d-617fda2ad8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d6d79e-5d89-4a51-8c37-35b418e8bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume a2c38903-1498-471d-bb2c-5e2a3c73c319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c38903-1498-471d-bb2c-5e2a3c73c319', 'volume_size': 1} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:52 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.186s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975161527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04f324f-6cb8-442f-bb90-b471743906f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:49Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Creating volume c04f324f-6cb8-442f-bb90-b471743906f3 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:52 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7571ea4a-f644-46d3-b970-c5e797a490af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2473accb-6c59-420a-95ee-b4108ad5d38e', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f71a907-6635-4f45-933d-52abe14dbe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:52 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 1073741824 Jul 09 16:51:52 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume volume-2473accb-6c59-420a-95ee-b4108ad5d38e (2473accb-6c59-420a-95ee-b4108ad5d38e): created successfully Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f71a907-6635-4f45-933d-52abe14dbe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (9c69b98d-71b5-4630-9392-62ed86453ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:52 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-320ffa0f-6446-4432-b1ef-d22c91f75392 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created volume successfully. Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Flow 'volume_create_manager' (0379838b-69c7-4506-863d-1c89bf9094ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c121e28-4d79-46ac-92cc-8628798caa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c121e28-4d79-46ac-92cc-8628798caa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34032df2e9784a8c9cd4f26044bf5afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:53Z,use_quota=True,user_id='4a502e2d4a8c4ea78121e1f7455833cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1003dc11-1e1c-46e1-923f-0d61bd7204ed),volume_type_id=1003dc11-1e1c-46e1-923f-0d61bd7204ed)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d216dd1-6205-4ba0-806b-25660fdfeeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d216dd1-6205-4ba0-806b-25660fdfeeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d356e87-a545-4d13-8feb-2441b5aeefd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d356e87-a545-4d13-8feb-2441b5aeefd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec', 'volume_name': 'volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec', 'volume_size': 1, 'image_id': '05dd50f0-b353-481a-a4e6-e532f17e0c55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05dd50f0-b353-481a-a4e6-e532f17e0c55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c30416757877568daafb54c1b7252431', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34032df2e9784a8c9cd4f26044bf5afe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb1c3fff0eb01981abf3a0b9538aa8120935d8ff30674044053474e9dedd65dea2a8467cea91cc601fbe9057722e5d4da595509d9fbb1d8ad0c0635879c59841', 'id': '05dd50f0-b353-481a-a4e6-e532f17e0c55', 'created_at': datetime.datetime(2026, 7, 9, 14, 51, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05dd50f0-b353-481a-a4e6-e532f17e0c55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1767242-7caa-459b-a185-6524e8ba8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1767242-7caa-459b-a185-6524e8ba8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635d6034-65ca-4747-8198-1319267c70b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Volume da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec', 'volume_size': 1, 'image_id': '05dd50f0-b353-481a-a4e6-e532f17e0c55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05dd50f0-b353-481a-a4e6-e532f17e0c55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c30416757877568daafb54c1b7252431', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34032df2e9784a8c9cd4f26044bf5afe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb1c3fff0eb01981abf3a0b9538aa8120935d8ff30674044053474e9dedd65dea2a8467cea91cc601fbe9057722e5d4da595509d9fbb1d8ad0c0635879c59841', 'id': '05dd50f0-b353-481a-a4e6-e532f17e0c55', 'created_at': datetime.datetime(2026, 7, 9, 14, 51, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05dd50f0-b353-481a-a4e6-e532f17e0c55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Trying to clone da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec from image 05dd50f0-b353-481a-a4e6-e532f17e0c55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/05dd50f0-b353-481a-a4e6-e532f17e0c55', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (62cd7c7b-796a-4dba-aa2d-e5c491794fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1f65f5-77e6-4d5d-a99e-cdec422a68b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:51:53 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Image download 0.00 MB at 0.00 MB/s Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1f65f5-77e6-4d5d-a99e-cdec422a68b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-273996896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830b8ba8-a3a3-448f-965e-61f211a26006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:53Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338096b8-5120-4386-afdc-ab71fa23508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338096b8-5120-4386-afdc-ab71fa23508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f75aff-f007-44ea-bf84-db5179d7e333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f75aff-f007-44ea-bf84-db5179d7e333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830b8ba8-a3a3-448f-965e-61f211a26006', 'volume_name': 'volume-830b8ba8-a3a3-448f-965e-61f211a26006', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03441632-5569-4103-8890-fb494159e67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03441632-5569-4103-8890-fb494159e67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6c7b33-24fe-43fe-acac-435e1f689922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume 830b8ba8-a3a3-448f-965e-61f211a26006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830b8ba8-a3a3-448f-965e-61f211a26006', 'volume_size': 1} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (070dfdc8-9a71-42a5-904d-cdbb18fbd368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bad86d1-3250-41ae-a5cc-92f6d67b36c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bad86d1-3250-41ae-a5cc-92f6d67b36c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770766886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2f68e0-f119-40dd-aedc-eee5c740537b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:54Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e622c-167a-4ea1-8e0c-f0800852895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e622c-167a-4ea1-8e0c-f0800852895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4d3855-4b8c-4492-91cf-e3bf4bf38d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4d3855-4b8c-4492-91cf-e3bf4bf38d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2f68e0-f119-40dd-aedc-eee5c740537b', 'volume_name': 'volume-7f2f68e0-f119-40dd-aedc-eee5c740537b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30066a47-c097-450a-ab53-d09019ccfbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30066a47-c097-450a-ab53-d09019ccfbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e18dca-aa3d-402e-9fc4-2fc923a8c3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume 7f2f68e0-f119-40dd-aedc-eee5c740537b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2f68e0-f119-40dd-aedc-eee5c740537b', 'volume_size': 1} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ef5e0-a666-4198-95e1-d2f61a8c9ff5]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 1073741824" returned: 0 in 1.234s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (8f3510b5-2448-497d-9be0-8adf919cd286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174ec138-7d53-4dc7-be8f-94a3138ee916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174ec138-7d53-4dc7-be8f-94a3138ee916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-639520106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fc3b15-00e6-47ba-a8e6-1a267633c477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:54Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 Jul 09 16:51:54 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb152c1f-19c6-4fdf-8e98-3ea590b96f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb152c1f-19c6-4fdf-8e98-3ea590b96f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3785a28-3d8b-4954-8117-32556fb4ea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3785a28-3d8b-4954-8117-32556fb4ea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fc3b15-00e6-47ba-a8e6-1a267633c477', 'volume_name': 'volume-87fc3b15-00e6-47ba-a8e6-1a267633c477', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25e8981-5f09-4fb8-a6dc-e16afc19caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25e8981-5f09-4fb8-a6dc-e16afc19caf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcb8fc5-b306-486d-a29d-faff3af1baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume 87fc3b15-00e6-47ba-a8e6-1a267633c477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fc3b15-00e6-47ba-a8e6-1a267633c477', 'volume_size': 1} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (34292492-b5a0-4343-9c6a-8702aa12a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eeaa13c-4b87-4111-b826-109504cd6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eeaa13c-4b87-4111-b826-109504cd6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468391794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1b29dc-4da2-44b1-a785-d41de24df769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:54Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc201dc0-debc-44a1-b5cd-75ea70505b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc201dc0-debc-44a1-b5cd-75ea70505b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da948308-580b-4f14-b1f4-c676ebb6a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da948308-580b-4f14-b1f4-c676ebb6a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1b29dc-4da2-44b1-a785-d41de24df769', 'volume_name': 'volume-eb1b29dc-4da2-44b1-a785-d41de24df769', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24197912-70cc-4ac9-b58e-b63178369a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24197912-70cc-4ac9-b58e-b63178369a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58c54a7-6d59-46fe-8dc2-90be4970654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume eb1b29dc-4da2-44b1-a785-d41de24df769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1b29dc-4da2-44b1-a785-d41de24df769', 'volume_size': 1} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:54 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3" returned: 0 in 0.714s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.882s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-993158180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d936224-e839-4660-aa29-28f952519cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:50Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Creating volume 2d936224-e839-4660-aa29-28f952519cd5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:54 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:54 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:54 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 1073741824 Jul 09 16:51:54 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff0ff35-a5eb-4023-a6e5-13cbbacb4478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04f324f-6cb8-442f-bb90-b471743906f3', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885c7381-bbf5-40a0-9e6e-1e6ebeec1092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Volume volume-c04f324f-6cb8-442f-bb90-b471743906f3 (c04f324f-6cb8-442f-bb90-b471743906f3): created successfully Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885c7381-bbf5-40a0-9e6e-1e6ebeec1092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (65720d61-714a-48b7-920f-328bb4751e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-50e6eaa6-16f2-4d50-8a89-b3ca302b7a2f tempest-CreateVolumesFromImageTest-1728973391 None] Created volume successfully. Jul 09 16:51:54 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD Jul 09 16:51:54 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:55 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:51:55 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Temporary image 05dd50f0-b353-481a-a4e6-e532f17e0c55 is fetched for user 4a502e2d4a8c4ea78121e1f7455833cc. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:51:55 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 1073741824" returned: 0 in 0.858s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c68eab-0662-49e4-8e12-f7cf40b578a3]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:51:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:55 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 Jul 09 16:51:55 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:55 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD Jul 09 16:51:55 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:56 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.985s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1944511027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acbe2ad1-a072-4963-a175-418b05157f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:50Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Creating volume acbe2ad1-a072-4963-a175-418b05157f5d {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:56 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c735eeac-4cae-42f6-8ebc-a6635bc0ecc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d936224-e839-4660-aa29-28f952519cd5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c23e21-5544-454c-ab1e-07870faa2bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:56 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d 1073741824 Jul 09 16:51:56 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Volume volume-2d936224-e839-4660-aa29-28f952519cd5 (2d936224-e839-4660-aa29-28f952519cd5): created successfully Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c23e21-5544-454c-ab1e-07870faa2bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (d0059b56-95ee-4bcf-b6a7-b17c5038a6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-370c8807-1e95-4689-87c1-684916484298 tempest-CreateVolumesFromImageTest-1728973391 None] Created volume successfully. Jul 09 16:51:56 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:56 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD Jul 09 16:51:56 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:57 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD" returned: 1 in 0.726s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:57 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d 1073741824" returned: 0 in 0.860s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:57 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d Jul 09 16:51:57 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:57 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d" returned: 0 in 0.659s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.165s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-586445305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33832cf8-994e-4d07-866c-3331581cfa02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:50Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Creating volume 33832cf8-994e-4d07-866c-3331581cfa02 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:57 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b614ee5f-b967-45c2-9dde-aebd72379956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acbe2ad1-a072-4963-a175-418b05157f5d', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f588505b-2c7d-45b9-8adf-54752bb77187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:57 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 1073741824 Jul 09 16:51:57 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:57 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Volume volume-acbe2ad1-a072-4963-a175-418b05157f5d (acbe2ad1-a072-4963-a175-418b05157f5d): created successfully Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f588505b-2c7d-45b9-8adf-54752bb77187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:57 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (ccb00a13-f299-4448-b645-08d1a101c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:57 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a10fd216-8ce2-4f74-bf54-c4120a9058c6 tempest-CreateVolumesFromImageTest-1728973391 None] Created volume successfully. Jul 09 16:51:58 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 1073741824" returned: 0 in 0.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:58 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 Jul 09 16:51:58 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:59 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02" returned: 0 in 0.652s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.257s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1639144806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d122fc-f156-4dda-b978-7041d5ad73e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d1bb509ade4bcba83ebc1e6522efd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:51Z,use_quota=True,user_id='af40fd09745b47b1b466be0781210335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Creating volume e9d122fc-f156-4dda-b978-7041d5ad73e2 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:51:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd75e01-0700-4505-b436-605f621097bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33832cf8-994e-4d07-866c-3331581cfa02', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:59 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 1073741824 Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da62fee-6ebb-4c06-9374-6be668ae9824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:51:59 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:51:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Volume volume-33832cf8-994e-4d07-866c-3331581cfa02 (33832cf8-994e-4d07-866c-3331581cfa02): created successfully Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da62fee-6ebb-4c06-9374-6be668ae9824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:51:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (25617be0-5717-4b5f-a74a-fb96a2aadb72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:51:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7f9905da-bec8-41ff-9a0f-918163c7d495 tempest-CreateVolumesFromImageTest-1728973391 None] Created volume successfully. Jul 09 16:52:00 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 1073741824" returned: 0 in 0.815s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:00 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 Jul 09 16:52:00 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:00 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2" returned: 0 in 0.647s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.318s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986634362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c38903-1498-471d-bb2c-5e2a3c73c319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:52Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Creating volume a2c38903-1498-471d-bb2c-5e2a3c73c319 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:00 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 1073741824 Jul 09 16:52:00 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62bde57-ae79-4749-ab82-ad2e5e1442dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d122fc-f156-4dda-b978-7041d5ad73e2', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbae902-3da5-4943-b230-27779f8e38de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Volume volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 (e9d122fc-f156-4dda-b978-7041d5ad73e2): created successfully Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbae902-3da5-4943-b230-27779f8e38de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Flow 'volume_create_manager' (65a57f70-dd81-455f-a304-a0c75882ab0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c5f26f4e-9c8a-4db9-89a8-54e5d7e13dfb tempest-CreateVolumesFromImageTest-1728973391 None] Created volume successfully. Jul 09 16:52:01 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 1073741824" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:01 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 Jul 09 16:52:01 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-e9d122fc-f156-4dda-b978-7041d5ad73e2-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-e9d122fc-f156-4dda-b978-7041d5ad73e2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-quobyte-e9d122fc-f156-4dda-b978-7041d5ad73e2" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-e9d122fc-f156-4dda-b978-7041d5ad73e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6ef464-eecd-4e91-9e72-36d3805d6420]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:02 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 Jul 09 16:52:02 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:02 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319" returned: 0 in 0.666s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.672s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-273996896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830b8ba8-a3a3-448f-965e-61f211a26006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:53Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Creating volume 830b8ba8-a3a3-448f-965e-61f211a26006 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:02 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d6d79e-5d89-4a51-8c37-35b418e8bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c38903-1498-471d-bb2c-5e2a3c73c319', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:02 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 1073741824 Jul 09 16:52:02 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429f105c-b0ad-4b31-8755-3c1e42d47d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 (a2c38903-1498-471d-bb2c-5e2a3c73c319): created successfully Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429f105c-b0ad-4b31-8755-3c1e42d47d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (c206f4f5-af82-41cc-8f00-d435760a1895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-5b514e7d-4015-4cf5-9901-8f8cb2432e85 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created volume successfully. Jul 09 16:52:02 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2" returned: 0 in 0.764s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:02 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2 Jul 09 16:52:02 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:03 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 1073741824" returned: 0 in 0.831s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:03 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 Jul 09 16:52:03 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:03 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-e9d122fc-f156-4dda-b978-7041d5ad73e2" returned: 0 in 0.669s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-e9d122fc-f156-4dda-b978-7041d5ad73e2" released by "delete_volume" :: held 1.472s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Created reservations ['7fe9bed8-db45-4a29-9c3e-d1b8ef08ae71', 'e11636b3-f704-42e8-9d53-1016f44f7e79', '8da0aef3-02cb-4083-832f-a1e803584a4f', '3d10ba0b-11ca-4f3c-a12a-75941aba32c8'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:03 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:03 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:03 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006" returned: 0 in 0.638s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.119s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6c7b33-24fe-43fe-acac-435e1f689922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830b8ba8-a3a3-448f-965e-61f211a26006', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0be9717-c464-472f-b07c-738d43226dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Creating offline snapshot fdb9d7c8-94c6-4e33-953b-85b2b60f310d of volume 2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:52:03 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume volume-830b8ba8-a3a3-448f-965e-61f211a26006 (830b8ba8-a3a3-448f-965e-61f211a26006): created successfully Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0be9717-c464-472f-b07c-738d43226dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (62cd7c7b-796a-4dba-aa2d-e5c491794fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f69f3-fe63-4817-906f-00266c78e101]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-149f05bf-0786-459d-98de-b52d92aa0cd2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created volume successfully. Jul 09 16:52:04 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e Jul 09 16:52:04 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-33832cf8-994e-4d07-866c-3331581cfa02-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-33832cf8-994e-4d07-866c-3331581cfa02-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-quobyte-33832cf8-994e-4d07-866c-3331581cfa02" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-33832cf8-994e-4d07-866c-3331581cfa02" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a774587d-a43b-49cd-b06f-513f5b185eb0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:04 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:04 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Deleted volume successfully. Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4b2d70e1-a002-46f1-8a15-0cd440397237 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-e9d122fc-f156-4dda-b978-7041d5ad73e2-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:04 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 Jul 09 16:52:04 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:04 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:04 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d 1G Jul 09 16:52:04 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:05 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02" returned: 0 in 0.816s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:05 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02 Jul 09 16:52:05 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:05 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d 1G" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2473accb-6c59-420a-95ee-b4108ad5d38e -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:05 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2473accb-6c59-420a-95ee-b4108ad5d38e -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d Jul 09 16:52:05 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:05 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-33832cf8-994e-4d07-866c-3331581cfa02" returned: 0 in 0.682s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-33832cf8-994e-4d07-866c-3331581cfa02" released by "delete_volume" :: held 1.537s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Created reservations ['fab9200d-816e-4fa3-93af-323200b0963a', 'a52ec516-01df-4a9b-a005-6f6137702681', 'ba5f853e-b715-4d76-9ac1-b2155d2ed1c3', '9267129f-718d-4ebe-8458-6e8322506ea5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:05 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:05 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:06 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2473accb-6c59-420a-95ee-b4108ad5d38e -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d is being set with open permissions: ugo+rw Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:06 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d Jul 09 16:52:06 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-acbe2ad1-a072-4963-a175-418b05157f5d-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-acbe2ad1-a072-4963-a175-418b05157f5d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-quobyte-acbe2ad1-a072-4963-a175-418b05157f5d" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-acbe2ad1-a072-4963-a175-418b05157f5d" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a3d9ca-736c-4921-9961-1f139caf41fb]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:06 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Deleted volume successfully. Jul 09 16:52:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7194d1c3-c57b-4757-ba76-cf40b8da7dc8 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-33832cf8-994e-4d07-866c-3331581cfa02-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:06 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d Jul 09 16:52:06 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:07 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:07 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.info Jul 09 16:52:07 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:07 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:07 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d Jul 09 16:52:07 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:07 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.info" returned: 0 in 0.672s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:07 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.info is being set with open permissions: ugo+rw Jul 09 16:52:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:07 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.info Jul 09 16:52:07 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:08 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-acbe2ad1-a072-4963-a175-418b05157f5d" returned: 0 in 0.662s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-acbe2ad1-a072-4963-a175-418b05157f5d" released by "delete_volume" :: held 1.521s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Created reservations ['f58f5c06-e5a3-4666-92c2-fc5538d8cc01', '21491977-b66d-4d83-96c1-b46267112982', '8ba66e35-db43-4743-9313-568da7e9cb92', '41b093a4-4e40-4add-8f83-77eebf8e195d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:08 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:08 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:08 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.info" returned: 0 in 0.671s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.506s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.568s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770766886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2f68e0-f119-40dd-aedc-eee5c740537b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:54Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Creating volume 7f2f68e0-f119-40dd-aedc-eee5c740537b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:08 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b 1073741824 Jul 09 16:52:08 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-83261240-f226-4489-ab64-b975ce03ba1f tempest-CreateVolumesFromSnapshotTest-1715989545 None] Create snapshot completed successfully Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-2d936224-e839-4660-aa29-28f952519cd5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-2d936224-e839-4660-aa29-28f952519cd5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-quobyte-2d936224-e839-4660-aa29-28f952519cd5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-2d936224-e839-4660-aa29-28f952519cd5" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af0592c-51fc-45e0-b117-c998252ed837]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:08 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.665s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Deleted volume successfully. Jul 09 16:52:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-be44e61a-9431-4c2a-9dbd-aa2e0c4cf4c3 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-acbe2ad1-a072-4963-a175-418b05157f5d-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:08 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 Jul 09 16:52:08 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:09 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b 1073741824" returned: 0 in 0.964s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (59605757-ad62-49c1-a7b2-4f6273dcf98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1528b8-116d-4476-994e-4ecd95614658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1528b8-116d-4476-994e-4ecd95614658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-567294559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df96f6c3-b503-43ef-aef9-1379de974d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:09Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bdc5f3-e535-4537-baf9-799c75fad120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b Jul 09 16:52:09 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bdc5f3-e535-4537-baf9-799c75fad120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce38e24-716f-43c8-abca-7bcb7567fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce38e24-716f-43c8-abca-7bcb7567fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df96f6c3-b503-43ef-aef9-1379de974d88', 'volume_name': 'volume-df96f6c3-b503-43ef-aef9-1379de974d88', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c164a5d5-1d72-4bab-8a7d-f728edb74e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c164a5d5-1d72-4bab-8a7d-f728edb74e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934542b2-5a1b-4602-b120-a57f35c774e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume df96f6c3-b503-43ef-aef9-1379de974d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df96f6c3-b503-43ef-aef9-1379de974d88', 'volume_size': 1} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:09 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5" returned: 0 in 0.874s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:09 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5 Jul 09 16:52:09 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (5b4bb83c-8155-4268-8cb5-00477283ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e54f1d2-6dd8-43e2-bc38-211c4b72b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e54f1d2-6dd8-43e2-bc38-211c4b72b644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-837344280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600a3a41-fa27-4a30-8681-747875630158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:10Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e4fff5-eb8a-4a66-b2ec-49f8a4c317ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e4fff5-eb8a-4a66-b2ec-49f8a4c317ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d305e5a3-032e-40c7-a7ce-343a59af6432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d305e5a3-032e-40c7-a7ce-343a59af6432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600a3a41-fa27-4a30-8681-747875630158', 'volume_name': 'volume-600a3a41-fa27-4a30-8681-747875630158', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b870a39-15b8-4b8d-be0c-893e39599faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b870a39-15b8-4b8d-be0c-893e39599faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35157334-87fe-4713-891d-ea245fda37a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume 600a3a41-fa27-4a30-8681-747875630158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600a3a41-fa27-4a30-8681-747875630158', 'volume_size': 1} Jul 09 16:52:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:10 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.279s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-639520106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fc3b15-00e6-47ba-a8e6-1a267633c477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:54Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Creating volume 87fc3b15-00e6-47ba-a8e6-1a267633c477 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:10 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:10 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 1073741824 Jul 09 16:52:10 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (ddaf7116-5694-45b3-bd14-cf08144ebaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b6dc03-4d54-4d36-b67b-3c03f9719cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e18dca-aa3d-402e-9fc4-2fc923a8c3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2f68e0-f119-40dd-aedc-eee5c740537b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e6b887-c277-4385-a2b6-56a267185d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b6dc03-4d54-4d36-b67b-3c03f9719cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1405786101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de18e219-0bad-4db5-987f-bdfac0d501ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:10Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb91f55-f823-4713-9131-8ede3202e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb91f55-f823-4713-9131-8ede3202e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61605fa-2e2e-4273-83e1-994ce0475627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61605fa-2e2e-4273-83e1-994ce0475627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de18e219-0bad-4db5-987f-bdfac0d501ad', 'volume_name': 'volume-de18e219-0bad-4db5-987f-bdfac0d501ad', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ff2f90-4cde-4040-993a-c824df014661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ff2f90-4cde-4040-993a-c824df014661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0b3cc5-aa2c-421a-9988-9cec8efaf74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume de18e219-0bad-4db5-987f-bdfac0d501ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de18e219-0bad-4db5-987f-bdfac0d501ad', 'volume_size': 1} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume volume-7f2f68e0-f119-40dd-aedc-eee5c740537b (7f2f68e0-f119-40dd-aedc-eee5c740537b): created successfully Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e6b887-c277-4385-a2b6-56a267185d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (070dfdc8-9a71-42a5-904d-cdbb18fbd368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2d936224-e839-4660-aa29-28f952519cd5" returned: 0 in 0.882s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:10 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-10f26d4f-5059-4a3a-aa85-3b85626dc51b tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created volume successfully. Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-2d936224-e839-4660-aa29-28f952519cd5" released by "delete_volume" :: held 1.816s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Created reservations ['ba849afd-1100-4a9a-9b9c-0eb903ba7d61', '74b94d03-9926-4a0a-a40b-9d28c1e60b7a', 'ebbd0732-b259-4210-9b76-841d0210d58f', '67ff48b2-8025-497a-af9f-8acd5132bf23'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (817dc268-d944-472f-91c6-5b69cec9485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74acb186-6c66-4f40-ba6a-5d7f78ef62da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74acb186-6c66-4f40-ba6a-5d7f78ef62da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434784549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35685ce3-16a2-48d4-8577-b0bf5e3656e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:11Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f4ebbd-d0d2-47af-9e77-6cea4f53e99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f4ebbd-d0d2-47af-9e77-6cea4f53e99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf904aa0-8ebe-4b90-984f-fc5c68b19d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf904aa0-8ebe-4b90-984f-fc5c68b19d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35685ce3-16a2-48d4-8577-b0bf5e3656e0', 'volume_name': 'volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7896c8-aea5-451e-a77b-01e06869a7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7896c8-aea5-451e-a77b-01e06869a7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35cbd48-a80b-4bd4-966f-783bf6c5d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:10 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume 35685ce3-16a2-48d4-8577-b0bf5e3656e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0', 'volume_size': 1} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:10 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:10 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-c04f324f-6cb8-442f-bb90-b471743906f3-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-c04f324f-6cb8-442f-bb90-b471743906f3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (5dab40fe-a449-4d0c-8f1d-8a54a29ab543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d50200b-7ee5-48c6-a122-25841f549aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d50200b-7ee5-48c6-a122-25841f549aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408211462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be290f3-bad9-455b-9b97-7ef7f249f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:11Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952eda8b-5200-4efa-bc12-dcfe896528b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952eda8b-5200-4efa-bc12-dcfe896528b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6110d6-2c14-4ed0-8245-ffadb7ddcf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6110d6-2c14-4ed0-8245-ffadb7ddcf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be290f3-bad9-455b-9b97-7ef7f249f7e5', 'volume_name': 'volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce144ba-b9e4-42fb-be29-d6aafb52e97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce144ba-b9e4-42fb-be29-d6aafb52e97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e536417-b656-4f50-875e-258d2ebddece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:11 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume 3be290f3-bad9-455b-9b97-7ef7f249f7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5', 'volume_size': 1} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "cinder-quobyte-c04f324f-6cb8-442f-bb90-b471743906f3" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-c04f324f-6cb8-442f-bb90-b471743906f3" acquired by "delete_volume" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[03044d87-c88e-4580-b80d-878ec1ba34a1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:11 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 1073741824" returned: 0 in 1.087s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:11 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 Jul 09 16:52:11 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:11 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 Jul 09 16:52:11 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:11 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Deleted volume successfully. Jul 09 16:52:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-db6b8445-7573-46b2-9134-cefa2062fd18 tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-2d936224-e839-4660-aa29-28f952519cd5-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:12 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:12 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3 Jul 09 16:52:12 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:12 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477" returned: 0 in 0.687s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.812s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468391794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1b29dc-4da2-44b1-a785-d41de24df769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9a4a5e3a55c46eca29e999582c3ea6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:54Z,use_quota=True,user_id='233dcee11eae407fb3ade4ec00f91c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Creating volume eb1b29dc-4da2-44b1-a785-d41de24df769 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:12 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcb8fc5-b306-486d-a29d-faff3af1baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fc3b15-00e6-47ba-a8e6-1a267633c477', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:12 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 1073741824 Jul 09 16:52:12 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a6f50-ecec-4f35-8635-a538c8353a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:12 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 (87fc3b15-00e6-47ba-a8e6-1a267633c477): created successfully Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97a6f50-ecec-4f35-8635-a538c8353a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (8f3510b5-2448-497d-9be0-8adf919cd286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-48d04472-1df8-46d5-9d06-5d4ef5bcd9d5 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created volume successfully. Jul 09 16:52:12 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c04f324f-6cb8-442f-bb90-b471743906f3" returned: 0 in 0.652s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-quobyte-c04f324f-6cb8-442f-bb90-b471743906f3" released by "delete_volume" :: held 1.490s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Created reservations ['8d5c924e-dd96-476c-a26c-c2371df34c6e', '2c6bf209-ae47-45d4-9f07-419ef5f953dd', 'e429f090-9228-452f-9beb-1fd3583267e8', 'cdf167ab-d40f-4176-80b9-2ea930e98cee'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:12 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:12 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:13 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 1073741824" returned: 0 in 0.883s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:13 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 Jul 09 16:52:13 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:13 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.671s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Deleted volume successfully. Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-b8b25695-9145-4d00-b401-d6c7974b958c tempest-CreateVolumesFromImageTest-1728973391 None] Lock "cinder-c04f324f-6cb8-442f-bb90-b471743906f3-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:13 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769" returned: 0 in 0.675s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.706s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34032df2e9784a8c9cd4f26044bf5afe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:51:53Z,use_quota=True,user_id='4a502e2d4a8c4ea78121e1f7455833cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1003dc11-1e1c-46e1-923f-0d61bd7204ed),volume_type_id=1003dc11-1e1c-46e1-923f-0d61bd7204ed)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Creating volume da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:13 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:13 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec 1073741824 Jul 09 16:52:13 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58c54a7-6d59-46fe-8dc2-90be4970654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1b29dc-4da2-44b1-a785-d41de24df769', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46c9eee-86b1-45ef-8572-2dfbfdfbc83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Volume volume-eb1b29dc-4da2-44b1-a785-d41de24df769 (eb1b29dc-4da2-44b1-a785-d41de24df769): created successfully Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46c9eee-86b1-45ef-8572-2dfbfdfbc83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Flow 'volume_create_manager' (34292492-b5a0-4343-9c6a-8702aa12a160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fe940e83-b47b-49c3-8f42-a14a7e1fb541 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created volume successfully. Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-eb1b29dc-4da2-44b1-a785-d41de24df769-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-eb1b29dc-4da2-44b1-a785-d41de24df769-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-quobyte-eb1b29dc-4da2-44b1-a785-d41de24df769" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:14 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec 1073741824" returned: 0 in 0.983s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-eb1b29dc-4da2-44b1-a785-d41de24df769" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a19d0-300e-4f86-ac82-f33e14aaa980]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:14 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec Jul 09 16:52:14 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:14 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 Jul 09 16:52:14 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:15 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.991s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-567294559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df96f6c3-b503-43ef-aef9-1379de974d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:09Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Creating volume df96f6c3-b503-43ef-aef9-1379de974d88 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:15 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 1073741824 Jul 09 16:52:15 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Attempting download of 05dd50f0-b353-481a-a4e6-e532f17e0c55 ((None, [{'url': 'file:///opt/stack/data/glance/images/05dd50f0-b353-481a-a4e6-e532f17e0c55', 'metadata': {}}])) to volume da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[060917a1-4662-47f5-8c06-f32d9f9b02e0]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05dd50f0-b353-481a-a4e6-e532f17e0c55_saz7j3bv {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:15 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769" returned: 0 in 0.911s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:15 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769 Jul 09 16:52:15 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:15 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05dd50f0-b353-481a-a4e6-e532f17e0c55_saz7j3bv Jul 09 16:52:15 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:16 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-eb1b29dc-4da2-44b1-a785-d41de24df769" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-eb1b29dc-4da2-44b1-a785-d41de24df769" released by "delete_volume" :: held 1.721s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:16 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 1073741824" returned: 0 in 1.003s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:16 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created reservations ['4fda8721-6edf-478a-8a10-cf0a24ca4024', 'd2a963b1-e0df-4b23-95d7-975220070baa', '3193601e-9562-45a9-832d-f9d123362f40', '157d284c-7f19-429d-80e2-29c07169caae'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05dd50f0-b353-481a-a4e6-e532f17e0c55_saz7j3bv" returned: 0 in 0.920s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05dd50f0-b353-481a-a4e6-e532f17e0c55_saz7j3bv {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:16 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 Jul 09 16:52:16 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:16 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:16 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:16 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05dd50f0-b353-481a-a4e6-e532f17e0c55_saz7j3bv Jul 09 16:52:16 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-87fc3b15-00e6-47ba-a8e6-1a267633c477-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-87fc3b15-00e6-47ba-a8e6-1a267633c477-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-quobyte-87fc3b15-00e6-47ba-a8e6-1a267633c477" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-87fc3b15-00e6-47ba-a8e6-1a267633c477" acquired by "delete_volume" :: waited 0.042s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1768947-db18-433d-b2c3-1262e467c31f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:17 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 Jul 09 16:52:17 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:17 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.482s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-837344280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600a3a41-fa27-4a30-8681-747875630158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:10Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Creating volume 600a3a41-fa27-4a30-8681-747875630158 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:17 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 1073741824 Jul 09 16:52:17 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934542b2-5a1b-4602-b120-a57f35c774e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df96f6c3-b503-43ef-aef9-1379de974d88', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cb6071-c51b-4572-9c48-5c8795806036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume volume-df96f6c3-b503-43ef-aef9-1379de974d88 (df96f6c3-b503-43ef-aef9-1379de974d88): created successfully Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cb6071-c51b-4572-9c48-5c8795806036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (59605757-ad62-49c1-a7b2-4f6273dcf98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a0b503d7-75ec-4151-bee9-cffa90b9932d tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created volume successfully. Jul 09 16:52:17 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.960s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Deleted volume successfully. Jul 09 16:52:17 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-51d7872c-94b7-4ece-b9b9-7cd97388aaea tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-eb1b29dc-4da2-44b1-a785-d41de24df769-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05dd50f0-b353-481a-a4e6-e532f17e0c55_saz7j3bv" returned: 1 in 1.113s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05dd50f0-b353-481a-a4e6-e532f17e0c55_saz7j3bv' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7021aa7a-5ab1-4ed1-be56-7adc63bcdd38]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:17 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD Jul 09 16:52:17 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:18 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477" returned: 0 in 1.107s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:18 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477 Jul 09 16:52:18 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:18 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 1073741824" returned: 0 in 1.120s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:18 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD" returned: 0 in 0.846s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:18 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 Jul 09 16:52:18 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:18 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD Jul 09 16:52:18 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:19 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-87fc3b15-00e6-47ba-a8e6-1a267633c477" returned: 0 in 0.762s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-87fc3b15-00e6-47ba-a8e6-1a267633c477" released by "delete_volume" :: held 1.940s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created reservations ['254d8bda-1f29-4583-b512-c70e11c7ad3a', 'ffa423e2-4b7b-4240-ab35-53ff67b3558f', 'eb113f97-cab6-4843-a714-e85273201893', 'c0056dd7-08d1-44b7-adc2-dda043c876b2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:19 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:19 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-7f2f68e0-f119-40dd-aedc-eee5c740537b-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-7f2f68e0-f119-40dd-aedc-eee5c740537b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:19 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.915s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1405786101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de18e219-0bad-4db5-987f-bdfac0d501ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:10Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Creating volume de18e219-0bad-4db5-987f-bdfac0d501ad {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:19 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad 1073741824 Jul 09 16:52:19 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:19 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35157334-87fe-4713-891d-ea245fda37a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600a3a41-fa27-4a30-8681-747875630158', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028b7186-565b-4c11-8022-3aa9d31c1a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD" returned: 1 in 0.986s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] 05dd50f0-b353-481a-a4e6-e532f17e0c55 was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume volume-600a3a41-fa27-4a30-8681-747875630158 (600a3a41-fa27-4a30-8681-747875630158): created successfully Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028b7186-565b-4c11-8022-3aa9d31c1a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (5b4bb83c-8155-4268-8cb5-00477283ef66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:19 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-quobyte-7f2f68e0-f119-40dd-aedc-eee5c740537b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:19 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-997105d9-229e-4432-b210-06a46ad01401 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created volume successfully. Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-7f2f68e0-f119-40dd-aedc-eee5c740537b" acquired by "delete_volume" :: waited 0.066s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Flow 'volume_create_manager' (076a2eb8-8d45-4b37-a3f8-7cc12a5b6104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d9892a-a19c-4642-b8ba-3148a6182386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd7c224-d2bf-47c1-99e0-51228e4badf0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d9892a-a19c-4642-b8ba-3148a6182386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726ba583-db63-4fe3-9706-ec108d0daaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329b1ec33e4946b5bd4f6b009595905d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:20Z,use_quota=True,user_id='3b3254950eaa4a059ef4004c2154cc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2b8606-2845-4a10-a7ce-262b5b46dbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2b8606-2845-4a10-a7ce-262b5b46dbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c85aa5-f38e-4ad9-87ab-4d76778b81f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:19 devstack cinder-volume[87204]: DEBUG cinder.image.glance [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Creating Keystone auth plugin from conf {{(pid=87204) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 16:52:19 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b Jul 09 16:52:19 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c85aa5-f38e-4ad9-87ab-4d76778b81f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '726ba583-db63-4fe3-9706-ec108d0daaf5', 'volume_name': 'volume-726ba583-db63-4fe3-9706-ec108d0daaf5', 'volume_size': 1, 'image_id': '8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5ee04ca701e0fc5ce08a979c4f5dbf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '329b1ec33e4946b5bd4f6b009595905d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '091819add80a4d6fc6c694eb6bfd5c52e8303d85472b5879dac7d4a34d221c947c0a52592a7a57eff1d3b6a5af9450f96ddadeb064e7d2933beaabe7650fcf86', 'id': '8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'created_at': datetime.datetime(2026, 7, 9, 14, 52, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 52, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8007833a-a7e7-4986-a72a-f0da64d8c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8007833a-a7e7-4986-a72a-f0da64d8c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a375c4-bd73-48d3-b172-f75f3db838f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Volume 726ba583-db63-4fe3-9706-ec108d0daaf5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-726ba583-db63-4fe3-9706-ec108d0daaf5', 'volume_size': 1, 'image_id': '8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5ee04ca701e0fc5ce08a979c4f5dbf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '329b1ec33e4946b5bd4f6b009595905d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '091819add80a4d6fc6c694eb6bfd5c52e8303d85472b5879dac7d4a34d221c947c0a52592a7a57eff1d3b6a5af9450f96ddadeb064e7d2933beaabe7650fcf86', 'id': '8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'created_at': datetime.datetime(2026, 7, 9, 14, 52, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 52, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f/file', 'properties': {}}, 'image_service': } Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Trying to clone 726ba583-db63-4fe3-9706-ec108d0daaf5 from image 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'metadata': {}}]). {{(pid=87204) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 16:52:20 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.071s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:20 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Deleted volume successfully. Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-762840af-50a2-4109-af93-df2a1ff4c5f2 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-87fc3b15-00e6-47ba-a8e6-1a267633c477-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 16:52:20 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Image download 0.00 MB at 0.00 MB/s Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b27ac92-5340-4ed6-9a46-00857894c717]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:20 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD Jul 09 16:52:20 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:20 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:20 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" returned: 0 in 1.100s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad 1073741824" returned: 0 in 1.191s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_05dd50f0-b353-481a-a4e6-e532f17e0c55_srby5kdydevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:52:20 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:20 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec 1G Jul 09 16:52:20 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:20 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b" returned: 0 in 0.995s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:20 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad Jul 09 16:52:20 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:20 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b Jul 09 16:52:20 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:21 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:21 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD Jul 09 16:52:21 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:21 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad" returned: 0 in 0.735s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.689s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434784549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35685ce3-16a2-48d4-8577-b0bf5e3656e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:11Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Creating volume 35685ce3-16a2-48d4-8577-b0bf5e3656e0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:21 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec 1G" returned: 0 in 0.834s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:21 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7f2f68e0-f119-40dd-aedc-eee5c740537b" returned: 0 in 0.751s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:21 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 1073741824 Jul 09 16:52:21 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0b3cc5-aa2c-421a-9988-9cec8efaf74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de18e219-0bad-4db5-987f-bdfac0d501ad', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc430a4-e905-4dba-a306-b416028257fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-7f2f68e0-f119-40dd-aedc-eee5c740537b" released by "delete_volume" :: held 1.870s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e258d80-3975-4487-9e56-45580b9468b3]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume volume-de18e219-0bad-4db5-987f-bdfac0d501ad (de18e219-0bad-4db5-987f-bdfac0d501ad): created successfully Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc430a4-e905-4dba-a306-b416028257fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (ddaf7116-5694-45b3-bd14-cf08144ebaad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f8bfa736-67ba-4398-855b-fc6268ea0aa8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created volume successfully. Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created reservations ['808e1606-628f-4484-8b64-58c143d608b5', '13d5f8c0-8302-45ef-885a-a0d3bc3109b7', '6a9b903d-131e-4b5d-aa70-89ca754b767a', '271cec84-bc08-4819-8af3-9dc354ce3581'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:21 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec Jul 09 16:52:21 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:21 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:21 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:22 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD" returned: 1 in 0.949s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Temporary image 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f is fetched for user 3b3254950eaa4a059ef4004c2154cc84. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2335690-7ef9-435f-bfdb-1aa0bf3eccda]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:22 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" returned: 0 in 0.851s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:22 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD Jul 09 16:52:22 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:22 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec Jul 09 16:52:22 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:22 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 1073741824" returned: 0 in 1.042s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:22 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.783s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Deleted volume successfully. Jul 09 16:52:22 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 Jul 09 16:52:22 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-dabfa2f9-09c1-44d9-ad87-1bd326e2fcd0 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-7f2f68e0-f119-40dd-aedc-eee5c740537b-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-830b8ba8-a3a3-448f-965e-61f211a26006-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-830b8ba8-a3a3-448f-965e-61f211a26006-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-quobyte-830b8ba8-a3a3-448f-965e-61f211a26006" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-830b8ba8-a3a3-448f-965e-61f211a26006" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[11904090-5468-4f70-bacf-ac8d2f5c5f77]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:23 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:23 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 Jul 09 16:52:23 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:23 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0" returned: 0 in 0.727s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:23 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD Jul 09 16:52:23 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.068s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-408211462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be290f3-bad9-455b-9b97-7ef7f249f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f58bc20b0f441da2eeaba9a2f2c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:11Z,use_quota=True,user_id='9cf584512e8148308f54bf111ecb793e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Creating volume 3be290f3-bad9-455b-9b97-7ef7f249f7e5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:23 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:23 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35cbd48-a80b-4bd4-966f-783bf6c5d55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cff2c2c-3d57-44e4-b19a-cb61e63b0eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:23 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 1073741824 Jul 09 16:52:23 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" returned: 1 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Downloaded image 05dd50f0-b353-481a-a4e6-e532f17e0c55 ((None, [{'url': 'file:///opt/stack/data/glance/images/05dd50f0-b353-481a-a4e6-e532f17e0c55', 'metadata': {}}])) to volume da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Temporary image 05dd50f0-b353-481a-a4e6-e532f17e0c55 for user 4a502e2d4a8c4ea78121e1f7455833cc is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Marking volume da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:52:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 (35685ce3-16a2-48d4-8577-b0bf5e3656e0): created successfully Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cff2c2c-3d57-44e4-b19a-cb61e63b0eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (817dc268-d944-472f-91c6-5b69cec9485e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Copying metadata from image 05dd50f0-b353-481a-a4e6-e532f17e0c55 to da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Creating volume glance metadata for volume da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec backed by image 05dd50f0-b353-481a-a4e6-e532f17e0c55 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '05dd50f0-b353-481a-a4e6-e532f17e0c55', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c30416757877568daafb54c1b7252431', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:52:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7266f9f9-a4b5-40da-bf2d-3d6fc143e278 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created volume successfully. Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635d6034-65ca-4747-8198-1319267c70b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec', 'volume_size': 1, 'image_id': '05dd50f0-b353-481a-a4e6-e532f17e0c55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05dd50f0-b353-481a-a4e6-e532f17e0c55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c30416757877568daafb54c1b7252431', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34032df2e9784a8c9cd4f26044bf5afe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eb1c3fff0eb01981abf3a0b9538aa8120935d8ff30674044053474e9dedd65dea2a8467cea91cc601fbe9057722e5d4da595509d9fbb1d8ad0c0635879c59841', 'id': '05dd50f0-b353-481a-a4e6-e532f17e0c55', 'created_at': datetime.datetime(2026, 7, 9, 14, 51, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05dd50f0-b353-481a-a4e6-e532f17e0c55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38bbc0d-7238-49ab-ab2a-30eb6f98ed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Volume volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec (da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec): created successfully Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38bbc0d-7238-49ab-ab2a-30eb6f98ed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Flow 'volume_create_manager' (0379838b-69c7-4506-863d-1c89bf9094ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2e82d5e6-c66b-4cbd-8d18-9dad4863625d tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Created volume successfully. Jul 09 16:52:23 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:23 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006 Jul 09 16:52:23 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:23 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD" returned: 1 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Acquiring lock "cinder-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "cinder-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Acquiring lock "cinder-quobyte-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "cinder-quobyte-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:24 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 1073741824" returned: 0 in 1.014s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b39d35-b2d6-4bbf-b85c-a835a3ecc710]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:24 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 Jul 09 16:52:24 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:24 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec Jul 09 16:52:24 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:24 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-830b8ba8-a3a3-448f-965e-61f211a26006" returned: 0 in 0.757s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-830b8ba8-a3a3-448f-965e-61f211a26006" released by "delete_volume" :: held 1.675s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created reservations ['8e1eed1a-b7a3-4ba2-b7e6-dbf723c507a3', '499ea0b6-4c76-49d2-8e6d-5ace4c529f7b', '954e35b3-3494-4429-a9ab-97f9c0d8ee5b', 'f2dc6868-41e3-4c24-8c78-d1fc13f16de4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:24 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:24 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:25 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5" returned: 0 in 0.713s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726ba583-db63-4fe3-9706-ec108d0daaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329b1ec33e4946b5bd4f6b009595905d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:20Z,use_quota=True,user_id='3b3254950eaa4a059ef4004c2154cc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Creating volume 726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:25 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e536417-b656-4f50-875e-258d2ebddece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:25 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 1073741824 Jul 09 16:52:25 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643fade4-7bcb-47ac-82d6-dba92dd9680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:25 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Volume volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 (3be290f3-bad9-455b-9b97-7ef7f249f7e5): created successfully Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643fade4-7bcb-47ac-82d6-dba92dd9680b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Flow 'volume_create_manager' (5dab40fe-a449-4d0c-8f1d-8a54a29ab543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d849cdd8-5055-4493-8935-f4177abf9f64 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created volume successfully. Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-a2c38903-1498-471d-bb2c-5e2a3c73c319-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-a2c38903-1498-471d-bb2c-5e2a3c73c319-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:25 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" returned: 0 in 1.038s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-quobyte-a2c38903-1498-471d-bb2c-5e2a3c73c319" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-a2c38903-1498-471d-bb2c-5e2a3c73c319" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:25 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec Jul 09 16:52:25 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a620fb-a33f-40f7-b004-edc909de8cdf]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:25 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 Jul 09 16:52:25 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-3be290f3-bad9-455b-9b97-7ef7f249f7e5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-3be290f3-bad9-455b-9b97-7ef7f249f7e5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-3be290f3-bad9-455b-9b97-7ef7f249f7e5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-3be290f3-bad9-455b-9b97-7ef7f249f7e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:25 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.998s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6ffddd-66fa-41e8-a73b-612cb59c9857]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Deleted volume successfully. Jul 09 16:52:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6432922e-d94b-4a1d-832a-2a9a9c951f22 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-830b8ba8-a3a3-448f-965e-61f211a26006-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:26 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 Jul 09 16:52:26 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:26 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 1073741824" returned: 0 in 1.073s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:26 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 Jul 09 16:52:26 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:26 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" returned: 1 in 0.913s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:26 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec Jul 09 16:52:26 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:26 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319" returned: 0 in 1.112s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:26 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319 Jul 09 16:52:26 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:26 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5" returned: 0 in 0.943s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:26 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5 Jul 09 16:52:26 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:26 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5" returned: 0 in 0.734s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:27 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Attempting download of 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f ((None, [{'url': 'file:///opt/stack/data/glance/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'metadata': {}}])) to volume 726ba583-db63-4fe3-9706-ec108d0daaf5. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" returned: 0 in 0.721s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "cinder-quobyte-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec" released by "delete_volume" :: held 2.755s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4868b71f-a4c5-4e83-ac76-78d94c7b8ff5]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_ri4txc9p {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Created reservations ['c6b3b551-6c58-4d21-b69a-04d09f430766', 'd080da4f-199e-43fa-b72f-03fbefb5ffbf', 'fb2220b4-ad2c-4de8-b6a5-f9c60cb130d5', '5ccd8caf-4515-4205-b925-3505312607fa'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:27 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:27 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:27 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_ri4txc9p Jul 09 16:52:27 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:27 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a2c38903-1498-471d-bb2c-5e2a3c73c319" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-a2c38903-1498-471d-bb2c-5e2a3c73c319" released by "delete_volume" :: held 1.997s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:27 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3be290f3-bad9-455b-9b97-7ef7f249f7e5" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-3be290f3-bad9-455b-9b97-7ef7f249f7e5" released by "delete_volume" :: held 1.765s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created reservations ['69f05e98-a859-4281-a536-83fd9dafd7d0', 'c618c6b5-acb6-4c98-ba7f-b61875d2767f', '11b8aca9-158c-4aac-89b7-bfc685068e80', '9af72edb-e72b-46ce-9688-5963b6f2e3f8'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:27 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created reservations ['5765d5f1-18fc-4eae-931a-04cabffd3bc7', '2c31026c-9009-4c9f-b18d-579b28bd566a', 'c4e59e45-d049-4d61-af8f-b29c75968233', '5e72a069-6c32-431e-add5-f467659b3e32'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:27 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:27 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:27 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:28 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_ri4txc9p" returned: 0 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_ri4txc9p {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-35685ce3-16a2-48d4-8577-b0bf5e3656e0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-35685ce3-16a2-48d4-8577-b0bf5e3656e0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:28 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_ri4txc9p Jul 09 16:52:28 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-35685ce3-16a2-48d4-8577-b0bf5e3656e0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-35685ce3-16a2-48d4-8577-b0bf5e3656e0" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0001198-77e2-4cd7-ad28-488c6778a52f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:28 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.175s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Deleted volume successfully. Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8ae82236-70bd-4d16-a957-bdcf72f1ffba tempest-VolumeAndVolumeTypeFromImageTest-758395227 None] Lock "cinder-da4ca5a8-1f87-49c4-b4aa-ad4cb4e7e4ec-delete_volume" released by "delete_volume" :: held 4.256s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:28 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 Jul 09 16:52:28 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:28 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.939s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Deleted volume successfully. Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-16553839-533f-4d82-bb89-ab50bfd290f1 tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-a2c38903-1498-471d-bb2c-5e2a3c73c319-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:28 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-8ef31ae7-f743-47b8-9330-a33e21f37600-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:28 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:28 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 1.015s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-8ef31ae7-f743-47b8-9330-a33e21f37600-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Deleted volume successfully. Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f8503838-c74f-4859-8f28-bd30156aa670 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-3be290f3-bad9-455b-9b97-7ef7f249f7e5-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "cinder-quobyte-8ef31ae7-f743-47b8-9330-a33e21f37600" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-8ef31ae7-f743-47b8-9330-a33e21f37600" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3bee33-9b9d-4191-850e-3f635ad84083]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:29 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 Jul 09 16:52:29 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:29 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_ri4txc9p" returned: 1 in 1.272s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_ri4txc9p' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46abc14-1919-48f2-aba7-7e7ac5325e21]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:29 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD Jul 09 16:52:29 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:29 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0" returned: 0 in 1.351s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:29 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.953s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:29 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0 Jul 09 16:52:29 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:52:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:52:30 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600" returned: 0 in 1.028s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:30 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600 Jul 09 16:52:30 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:30 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD" returned: 0 in 1.050s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:30 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD Jul 09 16:52:30 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:30 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-35685ce3-16a2-48d4-8577-b0bf5e3656e0" returned: 0 in 0.939s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-35685ce3-16a2-48d4-8577-b0bf5e3656e0" released by "delete_volume" :: held 2.366s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created reservations ['fb744b00-7d4c-4f6e-b493-f4f4345ca9f3', '52c54cbb-ecaa-484b-9650-43d443400c5b', 'd355c723-865f-4bef-bfae-ef82d42170aa', '711d8d65-d9ba-416b-be40-0ee967fc69ee'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:30 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:30 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:30 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8ef31ae7-f743-47b8-9330-a33e21f37600" returned: 0 in 0.852s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-quobyte-8ef31ae7-f743-47b8-9330-a33e21f37600" released by "delete_volume" :: held 1.944s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Created reservations ['85ba8d47-25e7-4773-81d9-1a8159f5e06e', 'a7917532-6518-4ab2-8de7-dc62a221f8a2', '049dcf0c-0023-4107-af89-b365c3fd7ea1', '41e7b01e-ec8f-4355-969b-a3d9d2fbd489'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:31 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:31 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:31 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD" returned: 1 in 0.912s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f was raw, converting to raw {{(pid=87204) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:31 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 Jul 09 16:52:31 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-de18e219-0bad-4db5-987f-bdfac0d501ad-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-de18e219-0bad-4db5-987f-bdfac0d501ad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:31 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.896s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Deleted volume successfully. Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-de18e219-0bad-4db5-987f-bdfac0d501ad" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f47359c2-9378-4b2d-b5a2-ae55be6e568e tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-35685ce3-16a2-48d4-8577-b0bf5e3656e0-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-de18e219-0bad-4db5-987f-bdfac0d501ad" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9853f0e-6345-4ec8-8445-2d262a3098a3]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:31 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad Jul 09 16:52:31 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:32 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.910s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Deleted volume successfully. Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-67254dd0-ac9a-4d82-8d21-a1a7ddb5299f tempest-CreateVolumesFromSourceVolumeTest-1829371101 None] Lock "cinder-8ef31ae7-f743-47b8-9330-a33e21f37600-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:32 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5" returned: 0 in 1.066s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dda504d-dbb1-4b96-b2e7-2d51cbe7345f_v3dsoar9devstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:52:32 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:32 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 1G Jul 09 16:52:32 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:32 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:32 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad Jul 09 16:52:32 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:33 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 1G" returned: 0 in 0.965s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbc6d43-1707-4afb-ba58-f8c526fcae26]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:33 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-de18e219-0bad-4db5-987f-bdfac0d501ad" returned: 0 in 0.825s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-de18e219-0bad-4db5-987f-bdfac0d501ad" released by "delete_volume" :: held 1.773s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:33 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 Jul 09 16:52:33 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created reservations ['a83ed0dc-fdc5-48bb-a6f6-472a96d1a32a', '27b22776-cc00-4368-8b54-fc23a11f2779', 'b8f17625-c2e8-4327-89bc-be9981bad71d', 'bc87b508-29f8-4729-8f12-c27a659a2017'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:33 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:33 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-600a3a41-fa27-4a30-8681-747875630158-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-600a3a41-fa27-4a30-8681-747875630158-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-600a3a41-fa27-4a30-8681-747875630158" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-600a3a41-fa27-4a30-8681-747875630158" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f59c6ed-d7ed-4f64-becd-2e9aff52ff86]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:34 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 Jul 09 16:52:34 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:34 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5" returned: 0 in 1.080s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:34 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 Jul 09 16:52:34 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:34 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.977s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Deleted volume successfully. Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ff199149-0381-4d33-aa8a-cec9729b5cb8 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-de18e219-0bad-4db5-987f-bdfac0d501ad-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (d156df36-7b4d-4cf5-b5c9-e2cd12961d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5a5e47-a144-46cb-ad3c-2b8a2cf36b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5a5e47-a144-46cb-ad3c-2b8a2cf36b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817700943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584d8673-032b-406a-a387-4e19dd8c1821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:35Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e666e96d-9fbe-4c36-80c3-00446ac5f28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e666e96d-9fbe-4c36-80c3-00446ac5f28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444fc597-af7b-463c-9234-014743ad8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444fc597-af7b-463c-9234-014743ad8229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584d8673-032b-406a-a387-4e19dd8c1821', 'volume_name': 'volume-584d8673-032b-406a-a387-4e19dd8c1821', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3dec91f-6925-49c0-a5bd-26c22b935847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3dec91f-6925-49c0-a5bd-26c22b935847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b367ad-ae63-4aa7-a473-1ad4c06f2795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Volume 584d8673-032b-406a-a387-4e19dd8c1821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584d8673-032b-406a-a387-4e19dd8c1821', 'volume_size': 1} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-817700943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584d8673-032b-406a-a387-4e19dd8c1821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:35Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Creating volume 584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:34 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:34 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 1073741824 Jul 09 16:52:34 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:35 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158" returned: 0 in 1.132s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:35 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158 Jul 09 16:52:35 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:35 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5" returned: 1 in 0.943s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Downloaded image 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f ((None, [{'url': 'file:///opt/stack/data/glance/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'metadata': {}}])) to volume 726ba583-db63-4fe3-9706-ec108d0daaf5 successfully. {{(pid=87204) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Temporary image 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f for user 3b3254950eaa4a059ef4004c2154cc84 is deleted. {{(pid=87204) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.volume_utils [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Marking volume 726ba583-db63-4fe3-9706-ec108d0daaf5 as bootable. {{(pid=87204) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Copying metadata from image 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f to 726ba583-db63-4fe3-9706-ec108d0daaf5. {{(pid=87204) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Creating volume glance metadata for volume 726ba583-db63-4fe3-9706-ec108d0daaf5 backed by image 8dda504d-dbb1-4b96-b2e7-2d51cbe7345f with: {'image_id': '8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a5ee04ca701e0fc5ce08a979c4f5dbf1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87204) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a375c4-bd73-48d3-b172-f75f3db838f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726ba583-db63-4fe3-9706-ec108d0daaf5', 'volume_size': 1, 'image_id': '8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5ee04ca701e0fc5ce08a979c4f5dbf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '329b1ec33e4946b5bd4f6b009595905d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '091819add80a4d6fc6c694eb6bfd5c52e8303d85472b5879dac7d4a34d221c947c0a52592a7a57eff1d3b6a5af9450f96ddadeb064e7d2933beaabe7650fcf86', 'id': '8dda504d-dbb1-4b96-b2e7-2d51cbe7345f', 'created_at': datetime.datetime(2026, 7, 9, 14, 52, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 14, 52, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dda504d-dbb1-4b96-b2e7-2d51cbe7345f/file', 'properties': {}}, 'image_service': }' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c675f-cdf6-4eff-ab3a-e0b6c8128492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:35 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Volume volume-726ba583-db63-4fe3-9706-ec108d0daaf5 (726ba583-db63-4fe3-9706-ec108d0daaf5): created successfully Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c675f-cdf6-4eff-ab3a-e0b6c8128492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Flow 'volume_create_manager' (076a2eb8-8d45-4b37-a3f8-7cc12a5b6104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:35 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9b5435e8-9e45-422d-bc96-8c11d904a2a6 tempest-VolumeImageDependencyTests-1016947173 None] Created volume successfully. Jul 09 16:52:35 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 1073741824" returned: 0 in 0.976s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:36 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 Jul 09 16:52:36 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:36 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-600a3a41-fa27-4a30-8681-747875630158" returned: 0 in 0.792s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-600a3a41-fa27-4a30-8681-747875630158" released by "delete_volume" :: held 1.985s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Acquiring lock "cinder-726ba583-db63-4fe3-9706-ec108d0daaf5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Lock "cinder-726ba583-db63-4fe3-9706-ec108d0daaf5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created reservations ['6082e9df-67cd-4f31-b941-66271233206e', '79bea23f-6cb6-4092-8df6-ddefa552c0ab', '3c1cae75-be65-488d-a604-81a6460faf43', 'aacc713e-8a31-420a-98d6-660c23b36dff'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Acquiring lock "cinder-quobyte-726ba583-db63-4fe3-9706-ec108d0daaf5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Lock "cinder-quobyte-726ba583-db63-4fe3-9706-ec108d0daaf5" acquired by "delete_volume" :: waited 0.053s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Flow 'volume_create_manager' (ae79b4d3-a723-4e49-bfbd-6f53f50a3484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a44949e-77bb-4a9b-9e9a-1dfa78cfa59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fd9600-a493-4705-8eb6-ba4ecad10208]: (4, 'raw') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a44949e-77bb-4a9b-9e9a-1dfa78cfa59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-815157362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c9e086-c1d5-46ab-a9bb-10da1390ca32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff807a652b54616a9f47e30d362fcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:36Z,use_quota=True,user_id='535e1935d0da4ef98e691e754baf6424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5fde3-122c-4a12-84bc-d534e3d789f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5fde3-122c-4a12-84bc-d534e3d789f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d841f488-4e09-4a29-82b2-0af2156612a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d841f488-4e09-4a29-82b2-0af2156612a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c9e086-c1d5-46ab-a9bb-10da1390ca32', 'volume_name': 'volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6b79ca-10c5-4555-8953-3a7091e99b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6b79ca-10c5-4555-8953-3a7091e99b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4768172a-7fc4-4072-836d-0b305d08157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Volume 12c9e086-c1d5-46ab-a9bb-10da1390ca32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32', 'volume_size': 1} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:36 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 Jul 09 16:52:36 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:36 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:36 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:36 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821" returned: 0 in 0.734s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-815157362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c9e086-c1d5-46ab-a9bb-10da1390ca32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff807a652b54616a9f47e30d362fcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:36Z,use_quota=True,user_id='535e1935d0da4ef98e691e754baf6424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Creating volume 12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:36 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:36 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 1073741824 Jul 09 16:52:36 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b367ad-ae63-4aa7-a473-1ad4c06f2795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584d8673-032b-406a-a387-4e19dd8c1821', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b22b462-7c36-4cd4-b2a3-28de5e715e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Volume volume-584d8673-032b-406a-a387-4e19dd8c1821 (584d8673-032b-406a-a387-4e19dd8c1821): created successfully Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b22b462-7c36-4cd4-b2a3-28de5e715e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (d156df36-7b4d-4cf5-b5c9-e2cd12961d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9d51349c-45ae-4c15-a23e-63d8435ea700 tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:52:37 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:37 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.681s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Deleted volume successfully. Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2cb8822b-56c8-437f-9d1e-d332b28f1128 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-600a3a41-fa27-4a30-8681-747875630158-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:37 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 Jul 09 16:52:37 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-df96f6c3-b503-43ef-aef9-1379de974d88-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-df96f6c3-b503-43ef-aef9-1379de974d88-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-df96f6c3-b503-43ef-aef9-1379de974d88" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-df96f6c3-b503-43ef-aef9-1379de974d88" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e943c7-dc77-4d19-841b-bba78c0a3f35]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:37 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 Jul 09 16:52:37 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:37 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 1073741824" returned: 0 in 0.937s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:37 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 Jul 09 16:52:37 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:38 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5" returned: 1 in 0.855s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5' failed. Not Retrying. {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:38 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5 Jul 09 16:52:38 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:38 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88" returned: 0 in 0.933s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:38 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88 Jul 09 16:52:38 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:38 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32" returned: 0 in 0.795s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.126s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Creating offline snapshot f15806f7-578c-46c3-8fc1-71d4a767a249 of volume 584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4768172a-7fc4-4072-836d-0b305d08157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086fa9cd-0474-4fd0-a0c9-8f503858dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[601fdbd5-188c-4105-a000-d3b85a5a6c60]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Volume volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 (12c9e086-c1d5-46ab-a9bb-10da1390ca32): created successfully Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086fa9cd-0474-4fd0-a0c9-8f503858dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Flow 'volume_create_manager' (ae79b4d3-a723-4e49-bfbd-6f53f50a3484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f6433350-f488-45b2-adce-b207c71813eb tempest-VolumeDependencyTests-1022204746 None] Created volume successfully. Jul 09 16:52:38 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 Jul 09 16:52:38 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:38 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-726ba583-db63-4fe3-9706-ec108d0daaf5" returned: 0 in 0.739s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Lock "cinder-quobyte-726ba583-db63-4fe3-9706-ec108d0daaf5" released by "delete_volume" :: held 2.511s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Created reservations ['e796cba0-0a47-4261-adfd-12ad4aa7cea2', '9bdfb98a-3285-4780-91b0-81ae2e4041cb', 'd5c37b12-b0c6-4839-82ff-5b9139924e17', '39291860-435c-4bd7-be37-4223329f9f28'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:38 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:38 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:39 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-df96f6c3-b503-43ef-aef9-1379de974d88" returned: 0 in 0.688s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-df96f6c3-b503-43ef-aef9-1379de974d88" released by "delete_volume" :: held 1.665s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created reservations ['8f56a2df-a3b5-4048-b35a-7ee86ff87809', '08d919f3-3141-4ed1-a809-e4beedceb77f', 'db4df280-c249-450f-9fad-3af9ef39832a', '82fadf17-a181-4e8d-9f2e-60be585d05c7'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:39 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:39 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:39 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:39 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 1G Jul 09 16:52:39 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-fdb9d7c8-94c6-4e33-953b-85b2b60f310d-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-fdb9d7c8-94c6-4e33-953b-85b2b60f310d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-2473accb-6c59-420a-95ee-b4108ad5d38e" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-2473accb-6c59-420a-95ee-b4108ad5d38e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-fdb9d7c8-94c6-4e33-953b-85b2b60f310d" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:39 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-fdb9d7c8-94c6-4e33-953b-85b2b60f310d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Deleting offline snapshot fdb9d7c8-94c6-4e33-953b-85b2b60f310d of volume 2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] snapshot_file for this snap is: volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.981s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:39 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Deleted volume successfully. Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[150041ae-74dc-4d9b-89f3-ddab9f0daba2]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2a28755f-4806-4329-851b-f9c194809c50 tempest-VolumeImageDependencyTests-1016947173 None] Lock "cinder-726ba583-db63-4fe3-9706-ec108d0daaf5-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:40 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d Jul 09 16:52:40 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:40 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Deleted volume successfully. Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-aefe7fea-bc54-4172-9383-15c2cbdd4bce tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-df96f6c3-b503-43ef-aef9-1379de974d88-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:40 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 1G" returned: 0 in 1.164s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-584d8673-032b-406a-a387-4e19dd8c1821 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:40 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-584d8673-032b-406a-a387-4e19dd8c1821 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 Jul 09 16:52:40 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:40 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2473accb-6c59-420a-95ee-b4108ad5d38e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f90dc8-1ad6-4880-aaa3-b08b69083656]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:40 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e Jul 09 16:52:40 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:41 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-584d8673-032b-406a-a387-4e19dd8c1821 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249" returned: 0 in 0.823s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:41 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 is being set with open permissions: ugo+rw Jul 09 16:52:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:41 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 Jul 09 16:52:41 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:41 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e" returned: 0 in 0.859s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:41 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d Jul 09 16:52:41 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:42 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249" returned: 0 in 0.660s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:42 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.info Jul 09 16:52:42 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:42 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d" returned: 0 in 0.796s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:42 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d Jul 09 16:52:42 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:42 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.info" returned: 0 in 0.708s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:42 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.info is being set with open permissions: ugo+rw Jul 09 16:52:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:42 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.info Jul 09 16:52:42 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=156,cinder:UPDATE=213,cinder:DELETE=21,cinder:INSERT=57 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:UPDATE=214,cinder:SELECT=146,cinder:INSERT=57,cinder:DELETE=19 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Flow 'volume_create_manager' (dd574281-bd42-464f-9de2-5906b98d1b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e486db-fb27-4b74-bde5-17c94f011795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e486db-fb27-4b74-bde5-17c94f011795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53b9255239f4626a29555d31e116d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:43Z,use_quota=True,user_id='2c7aadc4dfba496881288b031261da5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd420ca2-2c32-4cfe-be76-1a734f2ed644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd420ca2-2c32-4cfe-be76-1a734f2ed644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5af341f-0568-4495-bdbf-358712ee39d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5af341f-0568-4495-bdbf-358712ee39d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79', 'volume_name': 'volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cea8ea-3361-4e3e-a72e-1f7bdc2ebf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cea8ea-3361-4e3e-a72e-1f7bdc2ebf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a67916-7b4f-4a88-bac0-1688485d302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:43 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Volume 31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79', 'volume_size': 1} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:43 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e.fdb9d7c8-94c6-4e33-953b-85b2b60f310d" returned: 0 in 0.707s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-fdb9d7c8-94c6-4e33-953b-85b2b60f310d" released by "_delete_snapshot" :: held 3.391s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-2473accb-6c59-420a-95ee-b4108ad5d38e" released by "delete_snapshot" :: held 3.425s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created reservations ['f7f3190a-0920-4168-8f9b-bece71c50f09', 'efe04747-99c0-4e83-874d-5ce42a843141', '923bca80-3199-4573-b1ca-ae70534f7443', 'aa8f4307-8ae0-4ad2-9898-3944f80181d4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Delete snapshot completed successfully. Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-bc98d6e7-33a3-4127-af13-f2bd053d5c53 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-fdb9d7c8-94c6-4e33-953b-85b2b60f310d-delete_snapshot" released by "delete_snapshot" :: held 3.559s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:43 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.info" returned: 0 in 0.720s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.034s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.867s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Creating offline snapshot 537443c9-35ec-4675-ac02-92eba6041f31 of volume 12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:52:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8139c262-764e-4800-b754-c3e06bc6f3ce tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b902389-ff32-4825-a340-43dd3ad9b0e8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:43 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 Jul 09 16:52:43 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-2473accb-6c59-420a-95ee-b4108ad5d38e-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-2473accb-6c59-420a-95ee-b4108ad5d38e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "cinder-quobyte-2473accb-6c59-420a-95ee-b4108ad5d38e" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-2473accb-6c59-420a-95ee-b4108ad5d38e" acquired by "delete_volume" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb10062b-8d91-4cae-a1e3-621b650064a4]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:44 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e Jul 09 16:52:44 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:44 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:44 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 1G Jul 09 16:52:44 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-f15806f7-578c-46c3-8fc1-71d4a767a249-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Lock "cinder-f15806f7-578c-46c3-8fc1-71d4a767a249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-584d8673-032b-406a-a387-4e19dd8c1821" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-584d8673-032b-406a-a387-4e19dd8c1821" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-f15806f7-578c-46c3-8fc1-71d4a767a249" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-f15806f7-578c-46c3-8fc1-71d4a767a249" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot f15806f7-578c-46c3-8fc1-71d4a767a249 of volume 584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac457fd2-e9df-4b7e-b78b-c728cc0543ad]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:44 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 Jul 09 16:52:44 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:44 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:45 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e Jul 09 16:52:45 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:45 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 1G" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:45 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 Jul 09 16:52:45 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:45 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249" returned: 0 in 0.863s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-584d8673-032b-406a-a387-4e19dd8c1821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461995e-7010-4fc5-b216-58b1c38cc7be]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:45 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-2473accb-6c59-420a-95ee-b4108ad5d38e" returned: 0 in 0.689s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-quobyte-2473accb-6c59-420a-95ee-b4108ad5d38e" released by "delete_volume" :: held 1.579s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:45 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 Jul 09 16:52:45 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Created reservations ['b8815528-fb49-4984-af8a-dc3b48669923', '93af63b1-c108-4c2a-a9b8-0aeb872ac669', '1d2aec5a-31f8-4852-8d69-860cb7127575', '9b5bb82d-2dfa-4c00-957a-6a0da15b5d12'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:45 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:45 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:45 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31" returned: 0 in 0.750s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:45 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 is being set with open permissions: ugo+rw Jul 09 16:52:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:46 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 Jul 09 16:52:46 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:46 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821" returned: 0 in 0.815s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:46 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 Jul 09 16:52:46 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:46 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.756s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:46 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Deleted volume successfully. Jul 09 16:52:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e6e333ec-349a-4ac2-a64f-5971cace3079 tempest-CreateVolumesFromSnapshotTest-1715989545 None] Lock "cinder-2473accb-6c59-420a-95ee-b4108ad5d38e-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:46 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31" returned: 0 in 0.778s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:46 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.info Jul 09 16:52:46 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:47 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249" returned: 0 in 0.885s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:47 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249 Jul 09 16:52:47 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:47 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.info" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:47 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.info is being set with open permissions: ugo+rw Jul 09 16:52:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:47 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.info Jul 09 16:52:47 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:48 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821.f15806f7-578c-46c3-8fc1-71d4a767a249" returned: 0 in 0.701s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-f15806f7-578c-46c3-8fc1-71d4a767a249" released by "_delete_snapshot" :: held 3.374s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-584d8673-032b-406a-a387-4e19dd8c1821" released by "delete_snapshot" :: held 3.404s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Created reservations ['59b0416d-6625-4e17-bf48-ade0595a15e1', '56b4424f-4500-4daf-b08c-69a707bfe0e5', '93d3a17e-7146-40ee-bb91-62effaf91100', 'ba9cb61c-4f7c-4603-8e9f-3da08b9cb04b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:48 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.info" returned: 0 in 0.672s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.674s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.080s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53b9255239f4626a29555d31e116d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:43Z,use_quota=True,user_id='2c7aadc4dfba496881288b031261da5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Creating volume 31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:48 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:52:48 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 1073741824 Jul 09 16:52:48 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-d7c15fa3-b7d7-4cf5-aeb3-6eae140eb723 tempest-ProjectMemberTests-974675878 None] Lock "cinder-f15806f7-578c-46c3-8fc1-71d4a767a249-delete_snapshot" released by "delete_snapshot" :: held 3.645s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:48 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0e80ef7c-67e1-4628-990f-b72dbf917049 tempest-VolumeDependencyTests-1022204746 None] Create snapshot completed successfully Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-584d8673-032b-406a-a387-4e19dd8c1821-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Lock "cinder-584d8673-032b-406a-a387-4e19dd8c1821-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-584d8673-032b-406a-a387-4e19dd8c1821" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-584d8673-032b-406a-a387-4e19dd8c1821" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eedb559-fa53-4aaa-a22a-6b635078035d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:49 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 Jul 09 16:52:49 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:49 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 1073741824" returned: 0 in 1.049s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:49 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 Jul 09 16:52:49 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Flow 'volume_create_manager' (b7f4bd3a-2560-45b9-9b15-43e7e62d5548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34df9f57-1010-408f-8813-72818bd23003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34df9f57-1010-408f-8813-72818bd23003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-281807071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11c709c-7811-499b-9ecf-1d774ac18785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff807a652b54616a9f47e30d362fcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=537443c9-35ec-4675-ac02-92eba6041f31,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:50Z,use_quota=True,user_id='535e1935d0da4ef98e691e754baf6424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d582915c-d712-449c-b0fd-0850fd97f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d582915c-d712-449c-b0fd-0850fd97f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c85fbf-e536-4329-a821-d46c5f6596d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c85fbf-e536-4329-a821-d46c5f6596d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c11c709c-7811-499b-9ecf-1d774ac18785', 'volume_name': 'volume-c11c709c-7811-499b-9ecf-1d774ac18785', 'volume_size': 1, 'snapshot_id': '537443c9-35ec-4675-ac02-92eba6041f31'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8df862e-1992-4272-ad05-89f0f57136f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8df862e-1992-4272-ad05-89f0f57136f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196ab8d5-91cd-45d1-9215-0b852376059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:49 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Volume c11c709c-7811-499b-9ecf-1d774ac18785: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c11c709c-7811-499b-9ecf-1d774ac18785', 'volume_size': 1, 'snapshot_id': '537443c9-35ec-4675-ac02-92eba6041f31'} Jul 09 16:52:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:50 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821" returned: 0 in 1.026s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:50 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821 Jul 09 16:52:50 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:50 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79" returned: 0 in 0.729s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.185s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-quobyte-537443c9-35ec-4675-ac02-92eba6041f31-c11c709c-7811-499b-9ecf-1d774ac18785" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a67916-7b4f-4a88-bac0-1688485d302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e723c13f-3f3d-4c4a-9116-aaf43c1d2b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-537443c9-35ec-4675-ac02-92eba6041f31-c11c709c-7811-499b-9ecf-1d774ac18785" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Creating volume c11c709c-7811-499b-9ecf-1d774ac18785 from snapshot 537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-quobyte-c11c709c-7811-499b-9ecf-1d774ac18785" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:50 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Volume volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 (31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79): created successfully Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e723c13f-3f3d-4c4a-9116-aaf43c1d2b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Flow 'volume_create_manager' (dd574281-bd42-464f-9de2-5906b98d1b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-c11c709c-7811-499b-9ecf-1d774ac18785" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] snapshot: 537443c9-35ec-4675-ac02-92eba6041f31, volume: c11c709c-7811-499b-9ecf-1d774ac18785, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:52:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-09d4a577-5df6-4ff1-8495-1450425ba014 tempest-CinderUnicodeTest-176993890 None] Created volume successfully. Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d94d7-0a4c-45cf-b003-47abb7684a4c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:50 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 Jul 09 16:52:50 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:50 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-584d8673-032b-406a-a387-4e19dd8c1821" returned: 0 in 0.772s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-584d8673-032b-406a-a387-4e19dd8c1821" released by "delete_volume" :: held 1.879s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:50 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Created reservations ['1465337c-9161-4949-86a0-a79f6954ea25', '71375a5c-9566-4fd4-98bc-99787f80ceb3', '1a904412-be15-4be1-ae68-b74b8a245c1d', '55c0ee23-343b-4b38-b2c5-84d25d408989'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:51 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:52:51 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:51 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f380e4-e517-440c-adf4-f989bbe500c1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:51 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 Jul 09 16:52:51 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Flow 'volume_create_manager' (9d6cf43c-9701-4d40-9eb9-4bf087424963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4dd5b8-2ffb-4362-b355-a37c80c71d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4dd5b8-2ffb-4362-b355-a37c80c71d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-108169597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be830aad-44d2-41f8-b09b-a361a425c55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53b9255239f4626a29555d31e116d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:52Z,use_quota=True,user_id='2c7aadc4dfba496881288b031261da5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93aa6acc-1dcb-47c8-ac85-f3da3ce7e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93aa6acc-1dcb-47c8-ac85-f3da3ce7e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cdb246-74c0-4614-9dff-8ac3e7c1b3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cdb246-74c0-4614-9dff-8ac3e7c1b3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be830aad-44d2-41f8-b09b-a361a425c55a', 'volume_name': 'volume-be830aad-44d2-41f8-b09b-a361a425c55a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d25ac2c-e876-4384-831b-f9f2a5dc99a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d25ac2c-e876-4384-831b-f9f2a5dc99a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5ab3b9-6b1e-41c9-b284-9637df8ffd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Volume be830aad-44d2-41f8-b09b-a361a425c55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be830aad-44d2-41f8-b09b-a361a425c55a', 'volume_size': 1} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:51 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.893s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:51 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:52:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-8a2bc25b-9055-4041-87d8-5538811a5a56 tempest-ProjectMemberTests-974675878 None] Lock "cinder-584d8673-032b-406a-a387-4e19dd8c1821-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (5caff25e-2818-4186-a93a-1111903da962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a267ac0-a34a-4419-abc2-f71fa0c33e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a267ac0-a34a-4419-abc2-f71fa0c33e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1967819503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b9970d-8a95-4c4e-9e3f-79606dcc40bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:52Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1256729-a9b7-4ded-badf-e88c06b7dceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1256729-a9b7-4ded-badf-e88c06b7dceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f43bf23-2dde-4357-b363-9e362b51ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f43bf23-2dde-4357-b363-9e362b51ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b9970d-8a95-4c4e-9e3f-79606dcc40bd', 'volume_name': 'volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ad718-6e5f-4277-a951-79cd246cf89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ad718-6e5f-4277-a951-79cd246cf89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4b977b-3e71-47ba-a9b7-217c43ddf747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:52 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Volume c5b9970d-8a95-4c4e-9e3f-79606dcc40bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd', 'volume_size': 1} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:52 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32" returned: 0 in 1.093s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:52:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:52 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 Jul 09 16:52:52 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:57 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785" returned: 0 in 5.241s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:57 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ed171-b0a6-4149-a131-aee6ce6e0ff6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:57 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 Jul 09 16:52:57 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:58 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32" returned: 0 in 0.952s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:58 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:52:58 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Converted 1024.00 MB image at 195.32 MB/s Jul 09 16:52:58 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 is being set with open permissions: ugo+rw Jul 09 16:52:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:58 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 Jul 09 16:52:58 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:59 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785" returned: 0 in 0.644s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-c11c709c-7811-499b-9ecf-1d774ac18785" released by "_copy_volume_from_snapshot" :: held 8.921s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-537443c9-35ec-4675-ac02-92eba6041f31-c11c709c-7811-499b-9ecf-1d774ac18785" released by "_create_volume_from_snapshot" :: held 8.970s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.288s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-108169597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be830aad-44d2-41f8-b09b-a361a425c55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f53b9255239f4626a29555d31e116d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:52Z,use_quota=True,user_id='2c7aadc4dfba496881288b031261da5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Creating volume be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:52:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:59 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a 1073741824 Jul 09 16:52:59 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196ab8d5-91cd-45d1-9215-0b852376059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11c709c-7811-499b-9ecf-1d774ac18785', 'volume_size': 1, 'snapshot_id': '537443c9-35ec-4675-ac02-92eba6041f31'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9b6301-31d0-49bc-bb06-b58dff4a36eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:52:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Volume volume-c11c709c-7811-499b-9ecf-1d774ac18785 (c11c709c-7811-499b-9ecf-1d774ac18785): created successfully Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9b6301-31d0-49bc-bb06-b58dff4a36eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Flow 'volume_create_manager' (b7f4bd3a-2560-45b9-9b15-43e7e62d5548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:52:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-97b6941b-9feb-4b6f-89ef-eb0b482d2e78 tempest-VolumeDependencyTests-1022204746 None] Created volume successfully. Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-537443c9-35ec-4675-ac02-92eba6041f31-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-537443c9-35ec-4675-ac02-92eba6041f31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-quobyte-12c9e086-c1d5-46ab-a9bb-10da1390ca32" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-12c9e086-c1d5-46ab-a9bb-10da1390ca32" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-quobyte-537443c9-35ec-4675-ac02-92eba6041f31" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-537443c9-35ec-4675-ac02-92eba6041f31" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Deleting offline snapshot 537443c9-35ec-4675-ac02-92eba6041f31 of volume 12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] snapshot_file for this snap is: volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[61de09fd-e93d-4019-8c88-54408921cdc0]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:52:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:52:59 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 Jul 09 16:52:59 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:00 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a 1073741824" returned: 0 in 0.877s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:00 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a Jul 09 16:53:00 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:00 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31" returned: 0 in 0.822s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:53:00 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a" returned: 0 in 0.646s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.600s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1967819503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b9970d-8a95-4c4e-9e3f-79606dcc40bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:52:52Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Creating volume c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:00 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9770243-dd88-4133-87f5-a3999c9dec55]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:00 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd 1073741824 Jul 09 16:53:00 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5ab3b9-6b1e-41c9-b284-9637df8ffd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be830aad-44d2-41f8-b09b-a361a425c55a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a73ba4e-c8ee-4710-8208-81c880149bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Volume volume-be830aad-44d2-41f8-b09b-a361a425c55a (be830aad-44d2-41f8-b09b-a361a425c55a): created successfully Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a73ba4e-c8ee-4710-8208-81c880149bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Flow 'volume_create_manager' (9d6cf43c-9701-4d40-9eb9-4bf087424963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-697c69e2-bdb8-4254-84b0-1f87bdc1f7e8 tempest-CinderUnicodeTest-176993890 None] Created volume successfully. Jul 09 16:53:00 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 Jul 09 16:53:00 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:01 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:01 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd 1073741824" returned: 0 in 1.007s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32" returned: 0 in 0.989s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:01 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 Jul 09 16:53:01 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:01 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd Jul 09 16:53:01 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:02 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" returned: 0 in 0.696s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.721s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4b977b-3e71-47ba-a9b7-217c43ddf747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e499f80e-13bd-470e-ad51-22de37111bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Creating offline snapshot 81aa03c0-0c00-40bc-a8de-bfb0fe3de98c of volume be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:53:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Volume volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd (c5b9970d-8a95-4c4e-9e3f-79606dcc40bd): created successfully Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e499f80e-13bd-470e-ad51-22de37111bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (5caff25e-2818-4186-a93a-1111903da962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[837575c8-831f-46c7-934b-60bd3938b527]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:02 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31" returned: 0 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-010d523f-66a9-41bd-93e7-62fa977a710f tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:53:02 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31 Jul 09 16:53:02 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:02 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a Jul 09 16:53:02 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:03 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32.537443c9-35ec-4675-ac02-92eba6041f31" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-537443c9-35ec-4675-ac02-92eba6041f31" released by "_delete_snapshot" :: held 3.592s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-12c9e086-c1d5-46ab-a9bb-10da1390ca32" released by "delete_snapshot" :: held 3.618s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Created reservations ['02517e90-6649-4e9c-b6c4-fbce5e627058', '09f15f93-724f-4d9d-bb62-36a30d9f10f2', '76c0849e-525b-4fc9-a7b6-60f23c551ff1', '225795a3-7ae9-4ca7-9bc0-a9d3f45e376e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Delete snapshot completed successfully. Jul 09 16:53:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3516bd10-2333-464a-a779-b682f48e81eb tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-537443c9-35ec-4675-ac02-92eba6041f31-delete_snapshot" released by "delete_snapshot" :: held 3.767s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:03 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a" returned: 0 in 1.024s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:03 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c 1G Jul 09 16:53:03 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-12c9e086-c1d5-46ab-a9bb-10da1390ca32-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-12c9e086-c1d5-46ab-a9bb-10da1390ca32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-quobyte-12c9e086-c1d5-46ab-a9bb-10da1390ca32" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-12c9e086-c1d5-46ab-a9bb-10da1390ca32" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1c0ea-2b56-4331-9aba-d6652e79a081]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:04 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 Jul 09 16:53:04 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:04 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c 1G" returned: 0 in 0.933s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be830aad-44d2-41f8-b09b-a361a425c55a -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:04 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be830aad-44d2-41f8-b09b-a361a425c55a -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c Jul 09 16:53:04 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:05 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32" returned: 0 in 0.853s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:05 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32 Jul 09 16:53:05 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:05 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be830aad-44d2-41f8-b09b-a361a425c55a -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:05 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c is being set with open permissions: ugo+rw Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:05 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c Jul 09 16:53:05 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Flow 'volume_create_manager' (d08a0696-fee9-4112-84b3-75a3336f1615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da15cb7-4324-4fc9-b9f0-b62706241a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da15cb7-4324-4fc9-b9f0-b62706241a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760360487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b36dc6-b18d-4500-83bf-4d15a17b7e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c432466afd344919a0ca66338adaf0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:05Z,use_quota=True,user_id='98ddb9b2ecd44f04bfa012fd84706de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca725c1c-1e12-403d-8a7e-86a988b5db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca725c1c-1e12-403d-8a7e-86a988b5db2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb2c975-4cc8-4e92-bb29-40859051710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb2c975-4cc8-4e92-bb29-40859051710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b36dc6-b18d-4500-83bf-4d15a17b7e0f', 'volume_name': 'volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19e9b72-f583-4a3d-9208-014825306aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19e9b72-f583-4a3d-9208-014825306aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c40ab9-0a8c-4b69-8d60-d3354f0d9717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:05 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Volume c8b36dc6-b18d-4500-83bf-4d15a17b7e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f', 'volume_size': 1} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:05 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-12c9e086-c1d5-46ab-a9bb-10da1390ca32" returned: 0 in 0.682s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-12c9e086-c1d5-46ab-a9bb-10da1390ca32" released by "delete_volume" :: held 1.610s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Created reservations ['a477b1e3-aaa7-4616-87b5-fcdd9476f5b7', 'c56d39e1-f1a1-46c9-a120-15d4008966fd', 'f590fa65-25dd-47da-bc9f-685fd8b91b8d', '01a6884d-3074-40ad-bd42-5bc90a0561cd'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:05 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:05 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" returned: 0 in 0.645s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:05 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:06 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.info Jul 09 16:53:06 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-c11c709c-7811-499b-9ecf-1d774ac18785-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-c11c709c-7811-499b-9ecf-1d774ac18785-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "cinder-quobyte-c11c709c-7811-499b-9ecf-1d774ac18785" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-c11c709c-7811-499b-9ecf-1d774ac18785" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae427fbb-a69d-40b5-9558-b586c98e4300]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:06 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 Jul 09 16:53:06 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:06 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:06 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Deleted volume successfully. Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-95e14c9a-63cc-4ff8-ba4e-fc110e2984cf tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-12c9e086-c1d5-46ab-a9bb-10da1390ca32-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:06 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.info" returned: 0 in 0.722s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.info is being set with open permissions: ugo+rw Jul 09 16:53:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:06 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.info Jul 09 16:53:06 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:07 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:07 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785 Jul 09 16:53:07 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:07 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.info" returned: 0 in 0.650s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.881s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.411s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Creating offline snapshot 66f4922f-cde3-49f1-bba9-e8af736c43e4 of volume c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:53:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2ebddf59-3471-4f82-96c1-d92fb7ee147f tempest-CinderUnicodeTest-176993890 None] Create snapshot completed successfully Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbfd24-6dd9-4ab8-8c94-403a8051d28c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:07 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd Jul 09 16:53:07 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:07 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c11c709c-7811-499b-9ecf-1d774ac18785" returned: 0 in 0.657s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Acquiring lock "cinder-81aa03c0-0c00-40bc-a8de-bfb0fe3de98c-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-quobyte-c11c709c-7811-499b-9ecf-1d774ac18785" released by "delete_volume" :: held 1.510s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Lock "cinder-81aa03c0-0c00-40bc-a8de-bfb0fe3de98c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Acquiring lock "cinder-quobyte-be830aad-44d2-41f8-b09b-a361a425c55a" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-be830aad-44d2-41f8-b09b-a361a425c55a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Acquiring lock "cinder-quobyte-81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Deleting offline snapshot 81aa03c0-0c00-40bc-a8de-bfb0fe3de98c of volume be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] snapshot_file for this snap is: volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe26899d-a3f4-41b3-80ff-18b643dda0e8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Created reservations ['4e2507e5-f31a-4726-bcde-365502f7b2fc', 'd43b75e2-7dd2-4f42-a6f3-20a07c9e6a6f', 'aff59913-1ff8-44ab-9905-88da725bdc54', '37bd18aa-6f29-4edc-a60d-e8704a2df69c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:08 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:08 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:08 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c Jul 09 16:53:08 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:08 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:08 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 1G Jul 09 16:53:08 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:08 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.712s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Deleted volume successfully. Jul 09 16:53:08 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" returned: 0 in 0.848s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be830aad-44d2-41f8-b09b-a361a425c55a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-11ff0144-4437-4bc5-b71b-2b07f02ade62 tempest-VolumeDependencyTests-1022204746 None] Lock "cinder-c11c709c-7811-499b-9ecf-1d774ac18785-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7434fa-636c-4c0e-a652-ea1f0432b2e5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:09 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a Jul 09 16:53:09 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:09 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 1G" returned: 0 in 0.866s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:09 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 Jul 09 16:53:09 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:09 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4" returned: 0 in 0.744s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:09 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 is being set with open permissions: ugo+rw Jul 09 16:53:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:09 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 Jul 09 16:53:09 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:09 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a" returned: 0 in 0.935s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:09 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c Jul 09 16:53:09 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:10 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4" returned: 0 in 0.716s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:10 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.info Jul 09 16:53:10 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:10 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" returned: 0 in 0.787s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:10 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c Jul 09 16:53:10 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:11 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.info" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:11 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.info is being set with open permissions: ugo+rw Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:11 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.info Jul 09 16:53:11 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:11 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a.81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" returned: 0 in 0.710s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-81aa03c0-0c00-40bc-a8de-bfb0fe3de98c" released by "_delete_snapshot" :: held 3.402s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-be830aad-44d2-41f8-b09b-a361a425c55a" released by "delete_snapshot" :: held 3.436s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Created reservations ['3a179bf5-5aa4-474e-9a14-b986a5005420', '0ff017f1-1955-4b3b-8bd3-6212f98a1514', '633b331e-7da5-4ee4-983a-1a4937618218', 'fcc5167e-68fe-40fd-8b2d-81e336de661d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Delete snapshot completed successfully. Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-63b4c6cc-2605-46c3-aa51-09c900761abc tempest-CinderUnicodeTest-176993890 None] Lock "cinder-81aa03c0-0c00-40bc-a8de-bfb0fe3de98c-delete_snapshot" released by "delete_snapshot" :: held 3.594s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:11 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.info" returned: 0 in 0.694s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.590s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.518s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760360487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b36dc6-b18d-4500-83bf-4d15a17b7e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c432466afd344919a0ca66338adaf0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:05Z,use_quota=True,user_id='98ddb9b2ecd44f04bfa012fd84706de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Creating volume c8b36dc6-b18d-4500-83bf-4d15a17b7e0f {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:11 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:12 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f 1073741824 Jul 09 16:53:12 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-263ce6b0-bb2c-4485-be97-99f4ca189813 tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "cinder-be830aad-44d2-41f8-b09b-a361a425c55a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-be830aad-44d2-41f8-b09b-a361a425c55a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "cinder-quobyte-be830aad-44d2-41f8-b09b-a361a425c55a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-be830aad-44d2-41f8-b09b-a361a425c55a" acquired by "delete_volume" :: waited 0.035s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-cb60afa3-8396-41c7-8414-8ce797becd20 tempest-ProjectAdminTests-1951411060 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87204) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaab85e-3948-4573-b03b-124f6b7d7a97]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-66f4922f-cde3-49f1-bba9-e8af736c43e4-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Lock "cinder-66f4922f-cde3-49f1-bba9-e8af736c43e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-66f4922f-cde3-49f1-bba9-e8af736c43e4" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-66f4922f-cde3-49f1-bba9-e8af736c43e4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot 66f4922f-cde3-49f1-bba9-e8af736c43e4 of volume c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:53:12 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a Jul 09 16:53:12 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06bc391-d61e-4504-aed1-d4b5eb8736dc]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:12 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 Jul 09 16:53:12 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:12 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f 1073741824" returned: 0 in 0.915s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:12 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f Jul 09 16:53:12 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:13 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a" returned: 0 in 0.930s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:13 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a Jul 09 16:53:13 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:13 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4" returned: 0 in 0.946s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec2d9f2-569c-4b1c-a781-fe7c620075c1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:13 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd Jul 09 16:53:13 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:13 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c40ab9-0a8c-4b69-8d60-d3354f0d9717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd5dbd5-2c1f-4040-9eb8-0294def15c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:13 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Volume volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f (c8b36dc6-b18d-4500-83bf-4d15a17b7e0f): created successfully Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd5dbd5-2c1f-4040-9eb8-0294def15c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:13 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Flow 'volume_create_manager' (d08a0696-fee9-4112-84b3-75a3336f1615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:13 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7f66d3a3-026d-445a-bb24-7f2a2b0f2534 tempest-ProjectReaderTests-1604290668 None] Created volume successfully. Jul 09 16:53:14 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-be830aad-44d2-41f8-b09b-a361a425c55a" returned: 0 in 0.770s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-be830aad-44d2-41f8-b09b-a361a425c55a" released by "delete_volume" :: held 1.799s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Created reservations ['c27f3fbe-cb96-459a-99f9-c2ed157066d1', '40cc79f1-e974-4719-a00e-61498437e2d4', 'dbd83c5d-6a32-4488-a9df-a0f597690b63', 'a57a9948-5d4f-4db5-ac83-0ab54113b8d4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:14 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:14 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:14 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" returned: 0 in 0.914s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:14 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 Jul 09 16:53:14 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "cinder-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "cinder-quobyte-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[81018f5f-4074-4c9b-85b5-d027a3540f36]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:14 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 Jul 09 16:53:14 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:15 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.924s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Deleted volume successfully. Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7390c099-2c93-4978-97b4-a295f826a781 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-be830aad-44d2-41f8-b09b-a361a425c55a-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:15 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4" returned: 0 in 0.979s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Acquiring lock "cinder-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:15 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4 Jul 09 16:53:15 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Lock "cinder-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Acquiring lock "cinder-quobyte-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Lock "cinder-quobyte-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f" acquired by "delete_volume" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[99657a8f-ec32-4da6-983f-c94caf91eb5f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:15 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79" returned: 0 in 0.942s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:15 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79 Jul 09 16:53:15 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:15 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f Jul 09 16:53:15 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:16 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd.66f4922f-cde3-49f1-bba9-e8af736c43e4" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-66f4922f-cde3-49f1-bba9-e8af736c43e4" released by "_delete_snapshot" :: held 3.762s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" released by "delete_snapshot" :: held 3.799s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Created reservations ['477f216b-d25a-4214-a5e3-96223f59fbe8', 'bc33db79-dfcb-4bf3-9354-ea0b95b8bba4', '59c03946-303b-42e8-88ca-fb02e33d992b', 'f9bdcc96-7b61-47fd-8e2a-3b1f6b371d84'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:16 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-quobyte-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79" released by "delete_volume" :: held 1.777s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:16 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:53:16 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e8c3742f-12c4-4df5-8dca-5d7b378f0453 tempest-ProjectMemberTests-974675878 None] Lock "cinder-66f4922f-cde3-49f1-bba9-e8af736c43e4-delete_snapshot" released by "delete_snapshot" :: held 4.029s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f" returned: 0 in 0.911s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:16 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f Jul 09 16:53:16 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Created reservations ['1dc9403b-be73-40a0-a719-2927c8013db5', 'd44f6076-f323-440b-b356-561251838b31', 'b216e57a-753f-445a-b679-04fd56c181fd', '1c0cc156-0f4e-4f9f-903d-7915a644883d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:16 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:16 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Lock "cinder-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c544647-61a5-4c94-9aed-f926ba0ef8f5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:17 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd Jul 09 16:53:17 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:17 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f" returned: 0 in 0.826s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Lock "cinder-quobyte-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f" released by "delete_volume" :: held 1.797s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Created reservations ['373c76d9-af12-45c1-a5d5-2f188381c7dc', '80c52a61-4c7d-4a64-8254-4cd6c616ff5b', '1069a62c-b78a-4ed9-a7b4-12abd3620889', 'd8d277c6-5ee5-4be8-a474-c3011e2bfa23'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:17 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.932s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Deleted volume successfully. Jul 09 16:53:17 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:17 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (bff2f196-c233-4f72-86eb-567c43e24250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aa3a0b-5770-45a0-8f17-cd0e7e28eb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aa3a0b-5770-45a0-8f17-cd0e7e28eb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025803224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3957dc72-4d06-4cb0-9254-02688f57bca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:17Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd35f13-3dd4-422a-b88c-f93fb0f51a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd35f13-3dd4-422a-b88c-f93fb0f51a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd1aae-b040-4b72-93de-6dcf9c98d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bd1aae-b040-4b72-93de-6dcf9c98d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3957dc72-4d06-4cb0-9254-02688f57bca4', 'volume_name': 'volume-3957dc72-4d06-4cb0-9254-02688f57bca4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04739f33-22af-411a-bbbe-6a34385388b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04739f33-22af-411a-bbbe-6a34385388b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766fceaf-215c-4845-ba0a-fb0533695143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Volume 3957dc72-4d06-4cb0-9254-02688f57bca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3957dc72-4d06-4cb0-9254-02688f57bca4', 'volume_size': 1} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025803224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3957dc72-4d06-4cb0-9254-02688f57bca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:17Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Creating volume 3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:17 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:17 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7ad371dc-80ed-4fe8-9dfc-d97310fbdaa8 tempest-CinderUnicodeTest-176993890 None] Lock "cinder-31ea7edd-3cf2-47f9-bc17-2cd9a0a79c79-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:17 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 1073741824 Jul 09 16:53:17 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:18 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" returned: 0 in 1.143s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:18 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd Jul 09 16:53:18 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:18 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.948s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:18 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Deleted volume successfully. Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-85da6961-78f0-47c5-a1e2-b95e026eee5b tempest-ProjectReaderTests-1604290668 None] Lock "cinder-c8b36dc6-b18d-4500-83bf-4d15a17b7e0f-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Flow 'volume_create_manager' (1bda22c6-8bec-4a0a-bbaa-2cc699b2a5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e26fa5-bece-44bc-b2e9-6df56af9f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e26fa5-bece-44bc-b2e9-6df56af9f81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368767520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a391b670-e9ee-4090-9661-70921d2e26ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c432466afd344919a0ca66338adaf0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:18Z,use_quota=True,user_id='98ddb9b2ecd44f04bfa012fd84706de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c5a00-e613-491d-bf73-45a2f3dc57ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c5a00-e613-491d-bf73-45a2f3dc57ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0debc82-b9d0-45d6-a35e-cde13c3ba95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0debc82-b9d0-45d6-a35e-cde13c3ba95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a391b670-e9ee-4090-9661-70921d2e26ae', 'volume_name': 'volume-a391b670-e9ee-4090-9661-70921d2e26ae', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5580aa-b524-4181-b2df-0335f1d0ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5580aa-b524-4181-b2df-0335f1d0ff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690820cb-5c06-4044-a960-a229a1ef6b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:18 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Volume a391b670-e9ee-4090-9661-70921d2e26ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a391b670-e9ee-4090-9661-70921d2e26ae', 'volume_size': 1} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:18 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd" released by "delete_volume" :: held 2.046s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Created reservations ['c10b67b6-4e7e-48c0-b6a5-c960b5c98c62', 'e787697d-50bc-4bda-9c55-ccbae40210a5', 'b40ff246-5921-4594-93fc-80f94c4a7fbc', 'dc85366d-d51d-4a38-8096-38cd6a4ed65d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:18 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 1073741824" returned: 0 in 1.280s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:19 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:19 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:19 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 Jul 09 16:53:19 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:19 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368767520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a391b670-e9ee-4090-9661-70921d2e26ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c432466afd344919a0ca66338adaf0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:18Z,use_quota=True,user_id='98ddb9b2ecd44f04bfa012fd84706de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Creating volume a391b670-e9ee-4090-9661-70921d2e26ae {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:19 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:19 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:53:19 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae 1073741824 Jul 09 16:53:19 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766fceaf-215c-4845-ba0a-fb0533695143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3957dc72-4d06-4cb0-9254-02688f57bca4', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39655be4-de4a-4eb4-96e2-12b2c641620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:19 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Volume volume-3957dc72-4d06-4cb0-9254-02688f57bca4 (3957dc72-4d06-4cb0-9254-02688f57bca4): created successfully Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39655be4-de4a-4eb4-96e2-12b2c641620b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (bff2f196-c233-4f72-86eb-567c43e24250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-2c7f3206-c232-459a-8e94-b90ea5be78d5 tempest-ProjectMemberTests-974675878 None] Lock "cinder-c5b9970d-8a95-4c4e-9e3f-79606dcc40bd-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8000d31c-64e6-4227-9b81-61c09c349497 tempest-ProjectReaderTests-347065850 None] Created volume successfully. Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (3bdd0716-69ac-4790-bdcc-97eb5237f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79063dfe-45aa-4ffc-829b-aacf5272646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79063dfe-45aa-4ffc-829b-aacf5272646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673247950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2453092-8f9b-402d-8168-9059fbc7671b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:21Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac71bb7-09d6-49d2-9f09-f1d8ffd71ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac71bb7-09d6-49d2-9f09-f1d8ffd71ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec860b5-151c-4d38-b420-06a5a505ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec860b5-151c-4d38-b420-06a5a505ae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2453092-8f9b-402d-8168-9059fbc7671b', 'volume_name': 'volume-f2453092-8f9b-402d-8168-9059fbc7671b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52876648-f751-46b9-b793-5e4969c28389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52876648-f751-46b9-b793-5e4969c28389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704b2163-8af7-4bd6-9de2-cd377c4493b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:20 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Volume f2453092-8f9b-402d-8168-9059fbc7671b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2453092-8f9b-402d-8168-9059fbc7671b', 'volume_size': 1} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:20 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae 1073741824" returned: 0 in 1.053s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:20 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae Jul 09 16:53:20 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:21 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae" returned: 0 in 0.662s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673247950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2453092-8f9b-402d-8168-9059fbc7671b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:21Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Creating volume f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:21 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:21 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b 1073741824 Jul 09 16:53:21 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690820cb-5c06-4044-a960-a229a1ef6b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a391b670-e9ee-4090-9661-70921d2e26ae', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5568bb-15f2-45fd-8117-0975c9ef162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:21 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Volume volume-a391b670-e9ee-4090-9661-70921d2e26ae (a391b670-e9ee-4090-9661-70921d2e26ae): created successfully Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5568bb-15f2-45fd-8117-0975c9ef162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:21 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Flow 'volume_create_manager' (1bda22c6-8bec-4a0a-bbaa-2cc699b2a5ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:21 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-30e20fe5-bcaa-4747-8b21-34fd4a0d7e03 tempest-ProjectReaderTests-1604290668 None] Created volume successfully. Jul 09 16:53:22 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b 1073741824" returned: 0 in 0.900s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:22 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b Jul 09 16:53:22 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Acquiring lock "cinder-a391b670-e9ee-4090-9661-70921d2e26ae-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Lock "cinder-a391b670-e9ee-4090-9661-70921d2e26ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Acquiring lock "cinder-quobyte-a391b670-e9ee-4090-9661-70921d2e26ae" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Lock "cinder-quobyte-a391b670-e9ee-4090-9661-70921d2e26ae" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b72c86-c151-45b0-ab9b-dc14bb8feab3]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:23 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae Jul 09 16:53:23 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:23 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.371s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704b2163-8af7-4bd6-9de2-cd377c4493b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2453092-8f9b-402d-8168-9059fbc7671b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b51559-957a-4502-8d1a-6322be05e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Creating offline snapshot f8f545b9-7d2a-4db8-b40a-bc9dae229023 of volume 3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:53:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Volume volume-f2453092-8f9b-402d-8168-9059fbc7671b (f2453092-8f9b-402d-8168-9059fbc7671b): created successfully Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b51559-957a-4502-8d1a-6322be05e435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (3bdd0716-69ac-4790-bdcc-97eb5237f40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceec00d0-7106-47f5-b192-2eb68b1c4b7e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:23 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-aa90d18c-ded4-4be3-8858-8776e2e0f359 tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:53:23 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 Jul 09 16:53:23 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:23 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae" returned: 0 in 1.000s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:23 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae Jul 09 16:53:23 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:24 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4" returned: 0 in 0.937s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:24 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 1G Jul 09 16:53:24 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:24 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a391b670-e9ee-4090-9661-70921d2e26ae" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Lock "cinder-quobyte-a391b670-e9ee-4090-9661-70921d2e26ae" released by "delete_volume" :: held 1.855s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Created reservations ['dae2ed6e-a14b-43dc-a3e9-f6c296ee12fa', '48439e30-0f28-44a7-94e7-fcf68b7efa40', '94d14af5-a533-4c5e-bcf8-1818adab4b07', 'f16c9705-2401-4e53-a065-604fa30cb5f6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:24 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:24 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:25 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 1G" returned: 0 in 0.961s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3957dc72-4d06-4cb0-9254-02688f57bca4 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:25 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3957dc72-4d06-4cb0-9254-02688f57bca4 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 Jul 09 16:53:25 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:25 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.737s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:25 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:25 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Deleted volume successfully. Jul 09 16:53:25 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6e6c0e60-43fd-4de2-b886-ec0e9358e5c5 tempest-ProjectReaderTests-1604290668 None] Lock "cinder-a391b670-e9ee-4090-9661-70921d2e26ae-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:26 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3957dc72-4d06-4cb0-9254-02688f57bca4 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023" returned: 0 in 0.915s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:26 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 is being set with open permissions: ugo+rw Jul 09 16:53:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:26 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 Jul 09 16:53:26 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:26 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:26 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.info Jul 09 16:53:26 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:27 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.info" returned: 0 in 0.666s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:27 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.info is being set with open permissions: ugo+rw Jul 09 16:53:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:27 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.info Jul 09 16:53:27 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:28 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.info" returned: 0 in 0.622s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.994s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.190s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Creating offline snapshot 4b007d57-de27-46f5-b8e7-feb6cb153cc0 of volume f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[60819415-f34d-4154-9f26-1055dd8a83b5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:28 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-17035678-33b4-4add-b843-955577e03d70 tempest-ProjectReaderTests-347065850 None] Create snapshot completed successfully Jul 09 16:53:28 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b Jul 09 16:53:28 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:28 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:28 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:29 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b" returned: 0 in 0.888s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:29 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 1G Jul 09 16:53:29 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-f8f545b9-7d2a-4db8-b40a-bc9dae229023-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Lock "cinder-f8f545b9-7d2a-4db8-b40a-bc9dae229023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-3957dc72-4d06-4cb0-9254-02688f57bca4" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-3957dc72-4d06-4cb0-9254-02688f57bca4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-f8f545b9-7d2a-4db8-b40a-bc9dae229023" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-f8f545b9-7d2a-4db8-b40a-bc9dae229023" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Deleting offline snapshot f8f545b9-7d2a-4db8-b40a-bc9dae229023 of volume 3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] snapshot_file for this snap is: volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1dcde6-4c58-441f-bec6-a0283c2046d2]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (9a115da0-dc0c-4b8d-b4ca-751af9a17614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5206b7f-e6a1-49d6-9079-b21ac2617394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5206b7f-e6a1-49d6-9079-b21ac2617394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538105969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c207fa73-9b09-4a21-8df7-d3416e7b1f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:29Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b9e71b-03f0-47e8-95e0-2977c3893ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b9e71b-03f0-47e8-95e0-2977c3893ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381c40c-65cc-432e-a3fb-a1863e09f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381c40c-65cc-432e-a3fb-a1863e09f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c207fa73-9b09-4a21-8df7-d3416e7b1f89', 'volume_name': 'volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61941529-ae3b-4aea-839e-639b10258472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:29 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 Jul 09 16:53:29 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61941529-ae3b-4aea-839e-639b10258472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e65b7a-954a-49d5-8d3b-59d991f76c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:29 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Volume c207fa73-9b09-4a21-8df7-d3416e7b1f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89', 'volume_size': 1} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:29 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.898s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:53:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:53:30 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 1G" returned: 0 in 0.963s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2453092-8f9b-402d-8168-9059fbc7671b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:30 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2453092-8f9b-402d-8168-9059fbc7671b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 Jul 09 16:53:30 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:30 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023" returned: 0 in 0.912s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3957dc72-4d06-4cb0-9254-02688f57bca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd0c82a-29db-4df9-b616-2800dc8488c1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:30 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 Jul 09 16:53:30 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:30 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2453092-8f9b-402d-8168-9059fbc7671b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0" returned: 0 in 0.801s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:30 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 is being set with open permissions: ugo+rw Jul 09 16:53:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:30 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 Jul 09 16:53:30 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:31 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4" returned: 0 in 0.782s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:31 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 Jul 09 16:53:31 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:31 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0" returned: 0 in 0.656s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:31 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.info Jul 09 16:53:31 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:32 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023" returned: 0 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:32 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023 Jul 09 16:53:32 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:32 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.info" returned: 0 in 0.668s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:32 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.info is being set with open permissions: ugo+rw Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:32 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.info Jul 09 16:53:32 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:32 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4.f8f545b9-7d2a-4db8-b40a-bc9dae229023" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-f8f545b9-7d2a-4db8-b40a-bc9dae229023" released by "_delete_snapshot" :: held 3.322s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-3957dc72-4d06-4cb0-9254-02688f57bca4" released by "delete_snapshot" :: held 3.349s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Created reservations ['94b221d0-65d2-4e14-8eeb-ea380552bec4', 'b1dd42a8-c2b3-4d11-80e6-c5c0f43e9873', 'ab2c218d-8709-4e3c-8f8f-5be41648dc4b', 'c541e67a-f392-490a-b980-31fef906a1e4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:32 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Delete snapshot completed successfully. Jul 09 16:53:32 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-04b46a3d-eaf6-4d47-9e46-54f99ff33f96 tempest-ProjectReaderTests-347065850 None] Lock "cinder-f8f545b9-7d2a-4db8-b40a-bc9dae229023-delete_snapshot" released by "delete_snapshot" :: held 3.501s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:33 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.info" returned: 0 in 0.727s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.807s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.382s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538105969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c207fa73-9b09-4a21-8df7-d3416e7b1f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:29Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Creating volume c207fa73-9b09-4a21-8df7-d3416e7b1f89 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:33 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:33 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 1073741824 Jul 09 16:53:33 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-8db31124-e2f6-4115-8901-21c70b889119 tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-4b007d57-de27-46f5-b8e7-feb6cb153cc0-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Lock "cinder-4b007d57-de27-46f5-b8e7-feb6cb153cc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-f2453092-8f9b-402d-8168-9059fbc7671b" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-f2453092-8f9b-402d-8168-9059fbc7671b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-4b007d57-de27-46f5-b8e7-feb6cb153cc0" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-4b007d57-de27-46f5-b8e7-feb6cb153cc0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot 4b007d57-de27-46f5-b8e7-feb6cb153cc0 of volume f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-3957dc72-4d06-4cb0-9254-02688f57bca4-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6a303a-cedd-4b98-911c-363e2a391b8a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Lock "cinder-3957dc72-4d06-4cb0-9254-02688f57bca4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-3957dc72-4d06-4cb0-9254-02688f57bca4" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-3957dc72-4d06-4cb0-9254-02688f57bca4" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c390b78-4591-47e4-88df-8a428aa0a790]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:33 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 Jul 09 16:53:33 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:33 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 Jul 09 16:53:33 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:34 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 1073741824" returned: 0 in 1.030s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:34 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 Jul 09 16:53:34 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:34 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0" returned: 0 in 0.929s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2453092-8f9b-402d-8168-9059fbc7671b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdcd8c1-5668-45fb-9e44-663b59c970e1]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:34 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4" returned: 0 in 0.892s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:34 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b Jul 09 16:53:34 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:34 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4 Jul 09 16:53:34 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:34 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89" returned: 0 in 0.736s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e65b7a-954a-49d5-8d3b-59d991f76c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af13b6aa-af37-4f75-b0ba-30940e196477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:34 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Volume volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 (c207fa73-9b09-4a21-8df7-d3416e7b1f89): created successfully Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af13b6aa-af37-4f75-b0ba-30940e196477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:34 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (9a115da0-dc0c-4b8d-b4ca-751af9a17614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:34 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-2bba42cf-6a24-4e70-b6a7-fc6c617fe385 tempest-ProjectReaderTests-1972052702 None] Created volume successfully. Jul 09 16:53:35 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:35 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-3957dc72-4d06-4cb0-9254-02688f57bca4" returned: 0 in 0.644s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b" returned: 0 in 0.766s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-3957dc72-4d06-4cb0-9254-02688f57bca4" released by "delete_volume" :: held 1.628s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:35 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 Jul 09 16:53:35 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Created reservations ['787b09fd-0015-417d-a226-0e4e2e88d4d6', 'bd0561df-946d-4fb9-8fb9-c13ea2993204', 'a8f3fa04-4509-4262-b0d6-d6b1c858367d', '41d37489-d36e-438a-8504-e9ac7c0a9326'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:35 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:35 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:36 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-c207fa73-9b09-4a21-8df7-d3416e7b1f89-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0" returned: 0 in 0.775s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:36 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.692s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:36 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0 Jul 09 16:53:36 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Lock "cinder-c207fa73-9b09-4a21-8df7-d3416e7b1f89-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Deleted volume successfully. Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-01c53bf4-74dd-4181-a3bc-cc15571cd852 tempest-ProjectReaderTests-347065850 None] Lock "cinder-3957dc72-4d06-4cb0-9254-02688f57bca4-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-quobyte-c207fa73-9b09-4a21-8df7-d3416e7b1f89" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-c207fa73-9b09-4a21-8df7-d3416e7b1f89" acquired by "delete_volume" :: waited 0.030s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6613fc-a285-43c5-9f26-19c38dd3c3d5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:36 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 Jul 09 16:53:36 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (5832f971-b725-477b-bd6a-6375b6d4ccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c87af7-a3e4-4bb9-b77b-193e51acb4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c87af7-a3e4-4bb9-b77b-193e51acb4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-885824387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c95380-b2e6-4eae-990b-bf95f03d29c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:36Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dd5401-097a-4c6e-81f8-dafa7d354370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dd5401-097a-4c6e-81f8-dafa7d354370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ac4e70-ad5c-4993-a18e-da1083573842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ac4e70-ad5c-4993-a18e-da1083573842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c95380-b2e6-4eae-990b-bf95f03d29c0', 'volume_name': 'volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4448c8-968f-41e5-8929-bb53a051f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4448c8-968f-41e5-8929-bb53a051f179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2820003-5ba4-4e7e-bab5-5b561c350c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:36 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Volume a4c95380-b2e6-4eae-990b-bf95f03d29c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0', 'volume_size': 1} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-885824387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c95380-b2e6-4eae-990b-bf95f03d29c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:36Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Creating volume a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:36 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:36 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 1073741824 Jul 09 16:53:36 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:36 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b.4b007d57-de27-46f5-b8e7-feb6cb153cc0" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-4b007d57-de27-46f5-b8e7-feb6cb153cc0" released by "_delete_snapshot" :: held 3.355s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-f2453092-8f9b-402d-8168-9059fbc7671b" released by "delete_snapshot" :: held 3.385s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Created reservations ['9e2548dd-b77d-4917-a522-1bfc9efb5015', '0d1b38df-92e8-4b2f-8e1d-5cbf736fe828', '2dd3fb16-a2c8-421b-8626-b62900301112', '67e1b4d3-0328-4068-80b3-903b7db94231'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c7810acb-526a-4a46-a39f-3c7ed1bf1cfb tempest-ProjectMemberTests-974675878 None] Lock "cinder-4b007d57-de27-46f5-b8e7-feb6cb153cc0-delete_snapshot" released by "delete_snapshot" :: held 3.551s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:37 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:37 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89 Jul 09 16:53:37 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:37 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 1073741824" returned: 0 in 0.921s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:37 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 Jul 09 16:53:37 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-f2453092-8f9b-402d-8168-9059fbc7671b-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Lock "cinder-f2453092-8f9b-402d-8168-9059fbc7671b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:37 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-c207fa73-9b09-4a21-8df7-d3416e7b1f89" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-f2453092-8f9b-402d-8168-9059fbc7671b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-c207fa73-9b09-4a21-8df7-d3416e7b1f89" released by "delete_volume" :: held 1.486s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-f2453092-8f9b-402d-8168-9059fbc7671b" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87fda2a-03e9-48f9-9ec2-acd949dbdc47]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:37 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Created reservations ['6ba4e00b-84a1-4a95-b076-71ef363da54e', 'cac98730-d900-4b71-8ce8-d3643d4808d4', '52842366-d2f6-47ab-9fff-8684d06a42c4', '08a610e2-a9eb-4bf8-a64d-3d5077b64c96'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:38 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b Jul 09 16:53:38 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:38 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:38 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:38 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2820003-5ba4-4e7e-bab5-5b561c350c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803dca91-2791-49c1-adba-363f337d27a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Volume volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 (a4c95380-b2e6-4eae-990b-bf95f03d29c0): created successfully Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803dca91-2791-49c1-adba-363f337d27a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (5832f971-b725-477b-bd6a-6375b6d4ccf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3c41ba35-ad2a-400e-b194-47605a0597a2 tempest-ProjectReaderTests-347065850 None] Created volume successfully. Jul 09 16:53:38 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:38 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b Jul 09 16:53:38 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:38 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:38 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Deleted volume successfully. Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Creating offline snapshot 735f40b5-ba22-4130-8d02-b00974026244 of volume a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-7dd7a20f-51be-40c7-ac1a-15f78d5dfaa0 tempest-ProjectReaderTests-1972052702 None] Lock "cinder-c207fa73-9b09-4a21-8df7-d3416e7b1f89-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b04cf-ea7a-4a25-8c9f-30964535c357]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:39 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 Jul 09 16:53:39 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (922e6556-5b53-4487-9ec5-9d23e9eae515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8f48c6-49b3-4209-ac1d-aeb183f64952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8f48c6-49b3-4209-ac1d-aeb183f64952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774918992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e0dd7d-7183-43ee-b70c-a80cc7a91769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:39Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66d9eaa-c914-4d7b-af77-9cc0c6a3e666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66d9eaa-c914-4d7b-af77-9cc0c6a3e666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3be69eb-87fb-4b07-ade0-7daf2531e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3be69eb-87fb-4b07-ade0-7daf2531e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e0dd7d-7183-43ee-b70c-a80cc7a91769', 'volume_name': 'volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40c6ed4-2328-4896-a7fb-87e65979bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40c6ed4-2328-4896-a7fb-87e65979bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f723ec2-dbcc-4b53-bb30-6d388696c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Volume 66e0dd7d-7183-43ee-b70c-a80cc7a91769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769', 'volume_size': 1} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:39 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-f2453092-8f9b-402d-8168-9059fbc7671b" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-f2453092-8f9b-402d-8168-9059fbc7671b" released by "delete_volume" :: held 1.563s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Created reservations ['a04b2482-8feb-4fdc-b1ec-1ce0e2700bb0', '72f7e9e3-3a27-494f-9c8d-5b6b279540e3', 'c7384f43-5c6a-4607-acaa-4f697b081440', '7bb2fe21-e1d6-46bc-bb1a-44ab0a0a3f6a'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:39 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:39 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:39 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0" returned: 0 in 0.809s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:39 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 1G Jul 09 16:53:39 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:40 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.666s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ee84c874-fc26-4eac-81dc-e74b6a74d980 tempest-ProjectMemberTests-974675878 None] Lock "cinder-f2453092-8f9b-402d-8168-9059fbc7671b-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:40 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (c6096f53-4d5a-4745-a730-f5ad1679acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf1e098-49e7-4442-8fd2-722545efa063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 1G" returned: 0 in 0.845s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf1e098-49e7-4442-8fd2-722545efa063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574309033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0816044c-07c2-4880-a97d-cbf9c4203b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:40Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:40 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 Jul 09 16:53:40 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56595000-603d-46a3-9bb6-f472cefca9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56595000-603d-46a3-9bb6-f472cefca9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beae718-3b44-40c4-8f1b-44eabde36886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beae718-3b44-40c4-8f1b-44eabde36886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0816044c-07c2-4880-a97d-cbf9c4203b61', 'volume_name': 'volume-0816044c-07c2-4880-a97d-cbf9c4203b61', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f6a9a9-1aa6-4659-9f6e-8dae68508d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f6a9a9-1aa6-4659-9f6e-8dae68508d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c933b8-7d7d-45ee-b534-8916dc52f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:40 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Volume 0816044c-07c2-4880-a97d-cbf9c4203b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0816044c-07c2-4880-a97d-cbf9c4203b61', 'volume_size': 1} Jul 09 16:53:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:41 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:41 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 is being set with open permissions: ugo+rw Jul 09 16:53:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:41 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 Jul 09 16:53:41 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:41 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244" returned: 0 in 0.629s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:41 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.info Jul 09 16:53:41 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:42 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.info" returned: 0 in 0.673s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:42 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.info is being set with open permissions: ugo+rw Jul 09 16:53:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:42 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.info Jul 09 16:53:42 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:43 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.info" returned: 0 in 0.627s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.364s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.080s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774918992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e0dd7d-7183-43ee-b70c-a80cc7a91769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:39Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Creating volume 66e0dd7d-7183-43ee-b70c-a80cc7a91769 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:43 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=123,cinder:INSERT=42,cinder:UPDATE=187,cinder:DELETE=14 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:53:43 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 1073741824 Jul 09 16:53:43 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=149,cinder:INSERT=49,cinder:UPDATE=160,cinder:DELETE=14 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:53:43 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-25d6cce1-d317-4530-9b21-4357b20d1877 tempest-ProjectReaderTests-347065850 None] Create snapshot completed successfully Jul 09 16:53:43 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-735f40b5-ba22-4130-8d02-b00974026244-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 1073741824" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Lock "cinder-735f40b5-ba22-4130-8d02-b00974026244-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-a4c95380-b2e6-4eae-990b-bf95f03d29c0" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a4c95380-b2e6-4eae-990b-bf95f03d29c0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-735f40b5-ba22-4130-8d02-b00974026244" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-735f40b5-ba22-4130-8d02-b00974026244" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Deleting offline snapshot 735f40b5-ba22-4130-8d02-b00974026244 of volume a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] snapshot_file for this snap is: volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[863ed454-e7de-40b2-99cc-ea52f63fc8c8]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:44 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 Jul 09 16:53:44 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:44 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 Jul 09 16:53:44 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:44 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769" returned: 0 in 0.686s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.169s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-574309033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0816044c-07c2-4880-a97d-cbf9c4203b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:40Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Creating volume 0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:44 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 1073741824 Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f723ec2-dbcc-4b53-bb30-6d388696c628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:44 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03d4b90-bafc-4137-9826-886f05668058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Volume volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 (66e0dd7d-7183-43ee-b70c-a80cc7a91769): created successfully Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03d4b90-bafc-4137-9826-886f05668058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:44 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (922e6556-5b53-4487-9ec5-9d23e9eae515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244" returned: 0 in 0.747s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:53:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0971f597-a4c1-4466-9de3-c86196ddb405 tempest-ProjectReaderTests-1972052702 None] Created volume successfully. Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d8b053-84f6-4e29-b498-d994ac9af3c2]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:44 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 Jul 09 16:53:44 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-66e0dd7d-7183-43ee-b70c-a80cc7a91769-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-66e0dd7d-7183-43ee-b70c-a80cc7a91769-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-quobyte-66e0dd7d-7183-43ee-b70c-a80cc7a91769" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-66e0dd7d-7183-43ee-b70c-a80cc7a91769" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d7cd5-6177-41ac-bb60-a341ef6a9db6]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:45 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 Jul 09 16:53:45 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:45 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 1073741824" returned: 0 in 0.903s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:45 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0" returned: 0 in 0.864s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:45 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 Jul 09 16:53:45 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:45 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 Jul 09 16:53:45 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:46 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769" returned: 0 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:46 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769 Jul 09 16:53:46 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:46 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c933b8-7d7d-45ee-b534-8916dc52f052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0816044c-07c2-4880-a97d-cbf9c4203b61', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b48505-b4d2-4052-8ee6-952ece43d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Volume volume-0816044c-07c2-4880-a97d-cbf9c4203b61 (0816044c-07c2-4880-a97d-cbf9c4203b61): created successfully Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b48505-b4d2-4052-8ee6-952ece43d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (c6096f53-4d5a-4745-a730-f5ad1679acdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-355178e6-586c-42d8-b7de-864fc23a4edd tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:53:46 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:46 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244 Jul 09 16:53:46 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Creating offline snapshot e7ec2df8-44a8-4ec0-871a-228111a34273 of volume 0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaacbfe1-d7f9-4265-b9a3-165ee823552a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:47 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-66e0dd7d-7183-43ee-b70c-a80cc7a91769" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-66e0dd7d-7183-43ee-b70c-a80cc7a91769" released by "delete_volume" :: held 1.584s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Created reservations ['4565c3d9-d444-4a5f-9ef2-93bcbc06744d', 'b7b40b0a-bfea-42a5-91a2-8a0bece688eb', 'fd8b5df5-75f3-4a7c-a4f8-1a753c2492aa', 'a006b090-df87-4dff-8668-1c6c89efc944'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:47 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 Jul 09 16:53:47 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:47 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:47 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:47 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0.735f40b5-ba22-4130-8d02-b00974026244" returned: 0 in 0.742s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-735f40b5-ba22-4130-8d02-b00974026244" released by "_delete_snapshot" :: held 3.284s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a4c95380-b2e6-4eae-990b-bf95f03d29c0" released by "delete_snapshot" :: held 3.310s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Created reservations ['3f37d29e-4aed-4a99-8ef9-4e2a4029d0d3', '5d382ab7-7e6c-4aa4-bcf2-340f9ada736b', 'f0944963-c26b-47b0-8772-a7306bc395bc', '920aa469-53ac-4930-a7b2-234a5c9e87d1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Delete snapshot completed successfully. Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-38162841-dbb8-4f3a-a4a3-f3600f0e02d5 tempest-ProjectReaderTests-347065850 None] Lock "cinder-735f40b5-ba22-4130-8d02-b00974026244-delete_snapshot" released by "delete_snapshot" :: held 3.457s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:47 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61" returned: 0 in 0.821s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:47 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 1G Jul 09 16:53:47 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:47 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.733s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:47 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:47 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Deleted volume successfully. Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-081fc4f6-695e-49c0-8c74-0f999c67007f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-66e0dd7d-7183-43ee-b70c-a80cc7a91769-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (0c395340-02b2-4ff0-ad8c-d23808b6a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9450e8-11c8-4531-b896-2f247203c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9450e8-11c8-4531-b896-2f247203c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822946611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377a3f43-73af-4856-8ea8-183648dd7fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:48Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86390c9-6eaa-419b-8dcc-dae127bd75ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86390c9-6eaa-419b-8dcc-dae127bd75ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d253f3f-3d1d-41e7-8e2d-f7233714eec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d253f3f-3d1d-41e7-8e2d-f7233714eec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377a3f43-73af-4856-8ea8-183648dd7fa1', 'volume_name': 'volume-377a3f43-73af-4856-8ea8-183648dd7fa1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190976aa-a437-4725-97ce-ae032ac22176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190976aa-a437-4725-97ce-ae032ac22176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead6868a-c9fd-4bec-8036-5fbb6f901cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:48 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Volume 377a3f43-73af-4856-8ea8-183648dd7fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377a3f43-73af-4856-8ea8-183648dd7fa1', 'volume_size': 1} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-a4c95380-b2e6-4eae-990b-bf95f03d29c0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Lock "cinder-a4c95380-b2e6-4eae-990b-bf95f03d29c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-a4c95380-b2e6-4eae-990b-bf95f03d29c0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a4c95380-b2e6-4eae-990b-bf95f03d29c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bffcdd-5bb0-49db-b575-9b39e89d2b75]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:48 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 Jul 09 16:53:48 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:48 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 1G" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0816044c-07c2-4880-a97d-cbf9c4203b61 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:48 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0816044c-07c2-4880-a97d-cbf9c4203b61 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 Jul 09 16:53:48 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:49 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0" returned: 0 in 0.808s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:49 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0 Jul 09 16:53:49 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:49 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0816044c-07c2-4880-a97d-cbf9c4203b61 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273" returned: 0 in 0.684s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:49 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 is being set with open permissions: ugo+rw Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:49 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 Jul 09 16:53:49 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:49 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-a4c95380-b2e6-4eae-990b-bf95f03d29c0" returned: 0 in 0.622s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a4c95380-b2e6-4eae-990b-bf95f03d29c0" released by "delete_volume" :: held 1.490s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Created reservations ['30c47c21-41e7-4d4a-be2e-87ca82dd6cdb', '56112549-02ad-438f-a5d7-a59921b4de50', 'd9761a3e-a857-43d2-977f-5551af5ce668', 'e85392ab-fedd-4fd8-bbb6-7ab1f4aeadea'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:49 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:49 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:50 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273" returned: 0 in 0.667s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:50 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.info Jul 09 16:53:50 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:50 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.664s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:50 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Deleted volume successfully. Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-6dee9801-2cf8-4eac-95df-81fcbb5fc13e tempest-ProjectReaderTests-347065850 None] Lock "cinder-a4c95380-b2e6-4eae-990b-bf95f03d29c0-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:50 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.info" returned: 0 in 0.685s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:50 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.info is being set with open permissions: ugo+rw Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:50 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.info Jul 09 16:53:50 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (d85d8242-acaf-4444-952b-0605434c7510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51313206-c1f7-44d2-a67a-240f80068d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51313206-c1f7-44d2-a67a-240f80068d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899563166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b6676f-75a0-4f88-9ec9-213a5ee6f651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:51Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d11f68-1c90-47de-9abf-9eae85666a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:50 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d11f68-1c90-47de-9abf-9eae85666a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523854c6-b30e-45f6-aea9-c8598906ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523854c6-b30e-45f6-aea9-c8598906ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b6676f-75a0-4f88-9ec9-213a5ee6f651', 'volume_name': 'volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eabb58-4e04-466d-9d53-d2b2b73a8548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eabb58-4e04-466d-9d53-d2b2b73a8548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86f92c7-8437-476d-b800-74b2ec379800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:51 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Volume 62b6676f-75a0-4f88-9ec9-213a5ee6f651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651', 'volume_size': 1} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:51 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.info" returned: 0 in 0.669s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.461s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.229s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822946611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377a3f43-73af-4856-8ea8-183648dd7fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:48Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Creating volume 377a3f43-73af-4856-8ea8-183648dd7fa1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:51 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:51 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 1073741824 Jul 09 16:53:51 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-10b35cff-3098-45e9-a789-da5e9137c144 tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-e7ec2df8-44a8-4ec0-871a-228111a34273-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Lock "cinder-e7ec2df8-44a8-4ec0-871a-228111a34273-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-0816044c-07c2-4880-a97d-cbf9c4203b61" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:52 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 1073741824" returned: 0 in 0.828s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-0816044c-07c2-4880-a97d-cbf9c4203b61" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-e7ec2df8-44a8-4ec0-871a-228111a34273" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-e7ec2df8-44a8-4ec0-871a-228111a34273" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot e7ec2df8-44a8-4ec0-871a-228111a34273 of volume 0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b1f25-7c7b-4ca5-bb99-6c9eb667453d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:52 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 Jul 09 16:53:52 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:52 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 Jul 09 16:53:52 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:53 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1" returned: 0 in 0.686s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899563166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b6676f-75a0-4f88-9ec9-213a5ee6f651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:51Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Creating volume 62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:53 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:53 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 1073741824 Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead6868a-c9fd-4bec-8036-5fbb6f901cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377a3f43-73af-4856-8ea8-183648dd7fa1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:53 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb70effb-4691-4115-bfdd-4b5ea4b430c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Volume volume-377a3f43-73af-4856-8ea8-183648dd7fa1 (377a3f43-73af-4856-8ea8-183648dd7fa1): created successfully Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb70effb-4691-4115-bfdd-4b5ea4b430c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (0c395340-02b2-4ff0-ad8c-d23808b6a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9cac5a20-6e2f-4ae8-8f8c-2826c493f48e tempest-ProjectReaderTests-1972052702 None] Created volume successfully. Jul 09 16:53:53 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273" returned: 0 in 0.803s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0816044c-07c2-4880-a97d-cbf9c4203b61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc506423-6145-4663-8e7a-21fe13f0f31d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:53 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 Jul 09 16:53:53 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-377a3f43-73af-4856-8ea8-183648dd7fa1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-377a3f43-73af-4856-8ea8-183648dd7fa1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-quobyte-377a3f43-73af-4856-8ea8-183648dd7fa1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-377a3f43-73af-4856-8ea8-183648dd7fa1" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b3e43e-066d-4d38-99e8-f04145fc0717]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:53 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 Jul 09 16:53:53 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:53 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 1073741824" returned: 0 in 0.899s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:54 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61" returned: 0 in 0.820s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:54 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 Jul 09 16:53:54 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:54 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 Jul 09 16:53:54 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:54 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1" returned: 0 in 0.842s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:54 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1 Jul 09 16:53:54 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:54 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651" returned: 0 in 0.727s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86f92c7-8437-476d-b800-74b2ec379800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee83a8f-7291-497a-9dda-2b2e03ea7d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:54 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Volume volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 (62b6676f-75a0-4f88-9ec9-213a5ee6f651): created successfully Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee83a8f-7291-497a-9dda-2b2e03ea7d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (d85d8242-acaf-4444-952b-0605434c7510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:54 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273" returned: 0 in 0.778s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:54 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-12708f20-153c-4021-a255-86b003abdbce tempest-ProjectReaderTests-347065850 None] Created volume successfully. Jul 09 16:53:54 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273 Jul 09 16:53:54 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:55 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-377a3f43-73af-4856-8ea8-183648dd7fa1" returned: 0 in 0.673s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-377a3f43-73af-4856-8ea8-183648dd7fa1" released by "delete_volume" :: held 1.561s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Created reservations ['7c648a86-0284-479d-b617-e8b84667a38b', '68a8703d-8c28-4ebb-9cc5-b0697fe2ae4b', 'ca239dfd-45f7-4839-83a7-eb463512bde0', 'eb1cd505-b2a0-4ca7-bc8d-64153756c4ed'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Creating offline snapshot bfb60e25-0d13-4115-bdd3-2af1da017496 of volume 62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9718ec-988c-454b-bd13-b2a7e7ee1f9c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:55 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:55 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:55 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 Jul 09 16:53:55 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:55 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61.e7ec2df8-44a8-4ec0-871a-228111a34273" returned: 0 in 0.709s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-e7ec2df8-44a8-4ec0-871a-228111a34273" released by "_delete_snapshot" :: held 3.209s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-0816044c-07c2-4880-a97d-cbf9c4203b61" released by "delete_snapshot" :: held 3.240s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Created reservations ['dd74d8af-85d3-4724-9a9c-f4f0628779b6', '6b172ebe-4b00-4690-b179-494dde8e0583', '3a378d8d-701c-4150-b19f-be8f2c19c91d', 'f991a693-440a-480b-a127-a226d06b094b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:53:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0a550456-453c-409e-a1c6-d26e8c810081 tempest-ProjectMemberTests-974675878 None] Lock "cinder-e7ec2df8-44a8-4ec0-871a-228111a34273-delete_snapshot" released by "delete_snapshot" :: held 3.400s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:56 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.718s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:56 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Deleted volume successfully. Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-006f99c7-83d8-465d-bf20-23bf779caf2f tempest-ProjectReaderTests-1972052702 None] Lock "cinder-377a3f43-73af-4856-8ea8-183648dd7fa1-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:56 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651" returned: 0 in 0.856s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:56 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 1G Jul 09 16:53:56 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (31c2a179-d7ba-4e79-8878-f13aaed7f9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f88fb0-140e-4611-ba20-65c4b55d7b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f88fb0-140e-4611-ba20-65c4b55d7b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772865393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0e079e-a014-44d7-afcd-bb2f9311777a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:56Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a6dece-368d-4798-897d-2eed1a6786de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a6dece-368d-4798-897d-2eed1a6786de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb544c7d-eb77-45f1-977c-ce3f6e5681ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb544c7d-eb77-45f1-977c-ce3f6e5681ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b0e079e-a014-44d7-afcd-bb2f9311777a', 'volume_name': 'volume-7b0e079e-a014-44d7-afcd-bb2f9311777a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2660bf08-bee1-491c-8db2-480176b310ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2660bf08-bee1-491c-8db2-480176b310ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5e4be9-b6b7-46e7-a6b9-35671706f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:56 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Volume 7b0e079e-a014-44d7-afcd-bb2f9311777a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b0e079e-a014-44d7-afcd-bb2f9311777a', 'volume_size': 1} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-0816044c-07c2-4880-a97d-cbf9c4203b61-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Lock "cinder-0816044c-07c2-4880-a97d-cbf9c4203b61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-0816044c-07c2-4880-a97d-cbf9c4203b61" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-0816044c-07c2-4880-a97d-cbf9c4203b61" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3824f-10ec-4858-a9c6-8fb6170b80dd]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:53:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:56 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 Jul 09 16:53:56 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:57 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 1G" returned: 0 in 0.814s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:57 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 Jul 09 16:53:57 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:57 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61" returned: 0 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:57 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61 Jul 09 16:53:57 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:57 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496" returned: 0 in 0.701s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:57 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 is being set with open permissions: ugo+rw Jul 09 16:53:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:57 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 Jul 09 16:53:57 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:58 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-0816044c-07c2-4880-a97d-cbf9c4203b61" returned: 0 in 0.674s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-0816044c-07c2-4880-a97d-cbf9c4203b61" released by "delete_volume" :: held 1.526s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Created reservations ['67698c60-9785-4708-a6ee-4b302cf0e992', 'f0aecb98-4e09-4322-b305-15d0a812bfa3', '334b372c-800d-4ca5-9651-caebffdd2ff4', '565636c5-9753-450d-9c27-cc5fba2ddf10'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:58 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:53:58 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:58 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496" returned: 0 in 0.687s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:58 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.info Jul 09 16:53:58 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:58 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:53:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:53:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-791f7bee-475e-4fe1-b701-c746b3d85f34 tempest-ProjectMemberTests-974675878 None] Lock "cinder-0816044c-07c2-4880-a97d-cbf9c4203b61-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:53:59 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.info" returned: 0 in 0.671s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:59 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.info is being set with open permissions: ugo+rw Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:59 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.info Jul 09 16:53:59 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (8ec4bc01-f9a7-4da2-96bb-8559c96ac996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08b1d6e-ab4a-4fcd-b3ed-99002ad8046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08b1d6e-ab4a-4fcd-b3ed-99002ad8046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888642572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441979ed-0127-44e4-9d79-44dcdff16f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:59Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846227f3-cc25-4ef6-aa0a-810b6b92be05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846227f3-cc25-4ef6-aa0a-810b6b92be05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4b5abc-46e6-4b63-ae33-5ff6bdd08c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4b5abc-46e6-4b63-ae33-5ff6bdd08c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441979ed-0127-44e4-9d79-44dcdff16f9b', 'volume_name': 'volume-441979ed-0127-44e4-9d79-44dcdff16f9b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c3b90b-b990-4b58-bd3a-052f06c49adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c3b90b-b990-4b58-bd3a-052f06c49adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9796434d-5f9b-4338-9d5f-dc8f2f55e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:53:59 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Volume 441979ed-0127-44e4-9d79-44dcdff16f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441979ed-0127-44e4-9d79-44dcdff16f9b', 'volume_size': 1} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:59 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.info" returned: 0 in 0.649s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.469s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.451s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772865393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0e079e-a014-44d7-afcd-bb2f9311777a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee183aae485c48f5879b8b6d641c5b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:56Z,use_quota=True,user_id='4f87d728a4e1400db6127b7beefa52f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Creating volume 7b0e079e-a014-44d7-afcd-bb2f9311777a {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:53:59 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:53:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:53:59 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a 1073741824 Jul 09 16:53:59 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:53:59 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9020734f-5e53-4df6-8bf5-6f2e8a4e2483 tempest-ProjectReaderTests-347065850 None] Create snapshot completed successfully Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-bfb60e25-0d13-4115-bdd3-2af1da017496-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Lock "cinder-bfb60e25-0d13-4115-bdd3-2af1da017496-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-62b6676f-75a0-4f88-9ec9-213a5ee6f651" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-62b6676f-75a0-4f88-9ec9-213a5ee6f651" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-bfb60e25-0d13-4115-bdd3-2af1da017496" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-bfb60e25-0d13-4115-bdd3-2af1da017496" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Deleting offline snapshot bfb60e25-0d13-4115-bdd3-2af1da017496 of volume 62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] snapshot_file for this snap is: volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f860453-ac0b-4f39-afa0-66813d495533]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:00 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a 1073741824" returned: 0 in 0.892s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:00 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a Jul 09 16:54:00 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:00 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 Jul 09 16:54:00 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:01 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a" returned: 0 in 0.653s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888642572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441979ed-0127-44e4-9d79-44dcdff16f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:53:59Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Creating volume 441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:54:01 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:01 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b 1073741824 Jul 09 16:54:01 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a5e4be9-b6b7-46e7-a6b9-35671706f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0e079e-a014-44d7-afcd-bb2f9311777a', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51d5791-0342-4f31-a7be-d73ca1d33681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:01 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:54:01 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Volume volume-7b0e079e-a014-44d7-afcd-bb2f9311777a (7b0e079e-a014-44d7-afcd-bb2f9311777a): created successfully Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51d5791-0342-4f31-a7be-d73ca1d33681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Flow 'volume_create_manager' (31c2a179-d7ba-4e79-8878-f13aaed7f9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9ef13f-99e1-471f-b232-eb0aeb92162d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:01 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-edfabf39-81e8-48cc-83ca-844ffebf2755 tempest-ProjectReaderTests-1972052702 None] Created volume successfully. Jul 09 16:54:01 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 Jul 09 16:54:01 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:02 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b 1073741824" returned: 0 in 0.799s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:02 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b Jul 09 16:54:02 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:02 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:02 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 Jul 09 16:54:02 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-7b0e079e-a014-44d7-afcd-bb2f9311777a-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Lock "cinder-7b0e079e-a014-44d7-afcd-bb2f9311777a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Acquiring lock "cinder-quobyte-7b0e079e-a014-44d7-afcd-bb2f9311777a" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-7b0e079e-a014-44d7-afcd-bb2f9311777a" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f83bfa-874a-47d2-a8c8-04ffe82cba69]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:02 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a Jul 09 16:54:02 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:02 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b" returned: 0 in 0.703s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9796434d-5f9b-4338-9d5f-dc8f2f55e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441979ed-0127-44e4-9d79-44dcdff16f9b', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216d1a59-554e-4f0e-b409-bfb0ad94bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:02 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Volume volume-441979ed-0127-44e4-9d79-44dcdff16f9b (441979ed-0127-44e4-9d79-44dcdff16f9b): created successfully Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216d1a59-554e-4f0e-b409-bfb0ad94bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:02 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (8ec4bc01-f9a7-4da2-96bb-8559c96ac996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e84057af-5166-429b-9e4d-6254661bf69d tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:54:03 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496" returned: 0 in 0.840s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496 Jul 09 16:54:03 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:03 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a" returned: 0 in 0.834s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a Jul 09 16:54:03 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Creating offline snapshot ed2632b5-4e21-421d-8a24-8ac7908c8d2b of volume 441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f321008f-f362-4804-8606-e6ae6f299e92]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:03 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651.bfb60e25-0d13-4115-bdd3-2af1da017496" returned: 0 in 0.662s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:03 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b Jul 09 16:54:03 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-bfb60e25-0d13-4115-bdd3-2af1da017496" released by "_delete_snapshot" :: held 3.205s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-62b6676f-75a0-4f88-9ec9-213a5ee6f651" released by "delete_snapshot" :: held 3.233s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Created reservations ['362f7179-2a79-42ce-bed6-a6b467289e17', '440ab672-5ad8-47c1-908d-9701e63da63b', '4b2a3189-0527-4bd7-9ca2-8b836b16b929', '6e8aa1cc-0a46-4ee8-81c5-00ccd07f15e1'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:03 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Delete snapshot completed successfully. Jul 09 16:54:03 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-88419f70-4e56-47d4-8f5a-4f21f518763a tempest-ProjectReaderTests-347065850 None] Lock "cinder-bfb60e25-0d13-4115-bdd3-2af1da017496-delete_snapshot" released by "delete_snapshot" :: held 3.373s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:04 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-7b0e079e-a014-44d7-afcd-bb2f9311777a" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Lock "cinder-quobyte-7b0e079e-a014-44d7-afcd-bb2f9311777a" released by "delete_volume" :: held 1.574s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Created reservations ['2b865bcd-204c-4fa4-9f0a-b68ed04a5b6f', '0850d253-dd65-43e7-a838-27b8793a1484', 'b12f9981-f08e-4ceb-a533-e379d9b5aa99', '941f5d01-5a44-40f0-b05d-4394c1bd910d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:04 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:04 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:04 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b" returned: 0 in 0.817s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:04 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b 1G Jul 09 16:54:04 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-62b6676f-75a0-4f88-9ec9-213a5ee6f651-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Lock "cinder-62b6676f-75a0-4f88-9ec9-213a5ee6f651-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-62b6676f-75a0-4f88-9ec9-213a5ee6f651" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:04 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-62b6676f-75a0-4f88-9ec9-213a5ee6f651" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[63292cfe-3b23-4764-97d6-c0e316f3b9fe]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:05 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.717s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Deleted volume successfully. Jul 09 16:54:05 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 Jul 09 16:54:05 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-3ac63f25-7212-46f4-a2d0-8f7d1056db6d tempest-ProjectReaderTests-1972052702 None] Lock "cinder-7b0e079e-a014-44d7-afcd-bb2f9311777a-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:05 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b 1G" returned: 0 in 0.910s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441979ed-0127-44e4-9d79-44dcdff16f9b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:05 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441979ed-0127-44e4-9d79-44dcdff16f9b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b Jul 09 16:54:05 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:05 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651" returned: 0 in 0.895s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:05 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651 Jul 09 16:54:05 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:06 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-441979ed-0127-44e4-9d79-44dcdff16f9b -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:06 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b is being set with open permissions: ugo+rw Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:06 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b Jul 09 16:54:06 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:06 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-62b6676f-75a0-4f88-9ec9-213a5ee6f651" returned: 0 in 0.784s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-62b6676f-75a0-4f88-9ec9-213a5ee6f651" released by "delete_volume" :: held 1.757s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Created reservations ['b680679b-7923-45b1-93b1-13baff78714b', '5592429f-c78d-4a27-8df0-41880ae976ae', '9b514e06-c647-43fb-adff-a341c17d938b', '2e671748-2559-4706-b33e-38fbe157eff2'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:06 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b" returned: 0 in 0.728s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:06 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:06 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:06 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.info Jul 09 16:54:06 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:54:07 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:07 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (8e345ca4-7df9-41b2-be36-d20d90cec4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0b34f6-521f-4e1e-8e0d-1c80e90bed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.info" returned: 0 in 0.702s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.762s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:07 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.info is being set with open permissions: ugo+rw Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:07 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Deleted volume successfully. Jul 09 16:54:07 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.info Jul 09 16:54:07 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0b34f6-521f-4e1e-8e0d-1c80e90bed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457003235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cfda48-77c0-4068-9acd-b9f66bdb8218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:08Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276554e9-ddf2-494a-ab86-0c142fce80ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276554e9-ddf2-494a-ab86-0c142fce80ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55486ed-5a63-4320-8b47-ecd73750e660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55486ed-5a63-4320-8b47-ecd73750e660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4cfda48-77c0-4068-9acd-b9f66bdb8218', 'volume_name': 'volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bd145f-5ffe-4fc9-aae9-08d25fe6a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bd145f-5ffe-4fc9-aae9-08d25fe6a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514d034c-b2c6-4920-95ae-01a62edba213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:07 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Volume b4cfda48-77c0-4068-9acd-b9f66bdb8218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218', 'volume_size': 1} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:07 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-0e3a22fd-b689-4bd6-a06c-5888adf0958c tempest-ProjectReaderTests-347065850 None] Lock "cinder-62b6676f-75a0-4f88-9ec9-213a5ee6f651-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:08 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.info" returned: 0 in 0.664s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457003235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cfda48-77c0-4068-9acd-b9f66bdb8218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:08Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Creating volume b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:54:08 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:08 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 1073741824 Jul 09 16:54:08 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:08 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-48775e7e-8607-427f-bd6a-e96e8afc7c95 tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-ed2632b5-4e21-421d-8a24-8ac7908c8d2b-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-ed2632b5-4e21-421d-8a24-8ac7908c8d2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-441979ed-0127-44e4-9d79-44dcdff16f9b" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-441979ed-0127-44e4-9d79-44dcdff16f9b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-ed2632b5-4e21-421d-8a24-8ac7908c8d2b" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-ed2632b5-4e21-421d-8a24-8ac7908c8d2b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot ed2632b5-4e21-421d-8a24-8ac7908c8d2b of volume 441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b216e77-ce82-4c13-a0aa-1a649b4de218]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:09 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b Jul 09 16:54:09 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:09 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 1073741824" returned: 0 in 0.832s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:09 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 Jul 09 16:54:09 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:09 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b" returned: 0 in 0.775s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-441979ed-0127-44e4-9d79-44dcdff16f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f5e57c-4a0c-4ee9-9247-c982e63b328a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:09 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b Jul 09 16:54:09 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:09 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514d034c-b2c6-4920-95ae-01a62edba213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9e31ef-da11-4f7d-aedc-0efc6a88fecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:09 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Volume volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 (b4cfda48-77c0-4068-9acd-b9f66bdb8218): created successfully Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9e31ef-da11-4f7d-aedc-0efc6a88fecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:09 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (8e345ca4-7df9-41b2-be36-d20d90cec4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-3f2b9471-bd10-41a9-92f7-260735d20b65 tempest-ProjectReaderTests-347065850 None] Created volume successfully. Jul 09 16:54:10 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:10 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b Jul 09 16:54:10 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:10 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Creating offline snapshot a6834d63-4b98-4b21-8fed-6faba3653035 of volume b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:54:10 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec275b-1aa2-4a46-90a0-bed6e83dca3f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:10 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 Jul 09 16:54:10 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:11 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:11 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b Jul 09 16:54:11 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:11 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:11 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 1G Jul 09 16:54:11 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:11 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b.ed2632b5-4e21-421d-8a24-8ac7908c8d2b" returned: 0 in 0.669s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-ed2632b5-4e21-421d-8a24-8ac7908c8d2b" released by "_delete_snapshot" :: held 3.081s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-441979ed-0127-44e4-9d79-44dcdff16f9b" released by "delete_snapshot" :: held 3.108s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:12 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Created reservations ['707b628d-d886-436f-8c8b-ff4a98404d3c', '13d0dfca-5b70-405c-82d2-59adc06a0fad', '2c943fd9-8a49-496e-85f1-5abccb755c82', '8949c2c6-e927-4832-8a9f-228aced4921c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:12 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:54:12 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-c43aa583-d977-4b7d-ab17-28e4cf317d57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-ed2632b5-4e21-421d-8a24-8ac7908c8d2b-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:12 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 1G" returned: 0 in 0.839s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:12 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:12 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 Jul 09 16:54:12 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-441979ed-0127-44e4-9d79-44dcdff16f9b-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Lock "cinder-441979ed-0127-44e4-9d79-44dcdff16f9b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-441979ed-0127-44e4-9d79-44dcdff16f9b" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-441979ed-0127-44e4-9d79-44dcdff16f9b" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[481aba71-6ad8-4574-a66d-0157b16f53ca]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:13 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035" returned: 0 in 0.738s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:13 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 is being set with open permissions: ugo+rw Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:13 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 Jul 09 16:54:13 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:13 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b Jul 09 16:54:13 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:13 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035" returned: 0 in 0.675s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:13 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.info Jul 09 16:54:13 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:13 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b" returned: 0 in 0.802s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:13 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:14 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b Jul 09 16:54:14 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:14 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.info" returned: 0 in 0.662s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:14 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.info is being set with open permissions: ugo+rw Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:14 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.info Jul 09 16:54:14 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:14 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-441979ed-0127-44e4-9d79-44dcdff16f9b" returned: 0 in 0.658s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-441979ed-0127-44e4-9d79-44dcdff16f9b" released by "delete_volume" :: held 1.514s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Created reservations ['0c1ee130-e882-4a61-827c-f0d53c812759', 'fccc75c1-6fba-4376-82a5-bdda949bf71c', '48dec2b2-4557-46b3-a996-a1ca411e7a72', '35c5fa62-4881-4176-948b-421330ac4e05'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:14 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:14 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:14 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:15 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.info" returned: 0 in 0.669s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.462s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-22c81d2e-e4af-4ed2-9a7d-d31d0ea4bedd tempest-ProjectReaderTests-347065850 None] Create snapshot completed successfully Jul 09 16:54:15 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.645s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:15 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4cb04b8e-6e14-470d-8e51-d0f9cab49c87 tempest-ProjectMemberTests-974675878 None] Lock "cinder-441979ed-0127-44e4-9d79-44dcdff16f9b-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (5cc143c3-67c1-4761-b3ef-2563d016648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee32a478-d39b-4467-a32e-79583155ca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee32a478-d39b-4467-a32e-79583155ca27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-954877906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:16Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2fcb3d-779e-4148-8697-00e8cecafc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2fcb3d-779e-4148-8697-00e8cecafc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f16e0d-d4ef-4fa5-8b5a-e79637c86146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f16e0d-d4ef-4fa5-8b5a-e79637c86146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1', 'volume_name': 'volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6922fb-9131-4ead-8895-3ff9adb51430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6922fb-9131-4ead-8895-3ff9adb51430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac42feb3-30cd-460f-8ccf-171fa53c790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:15 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Volume 78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1', 'volume_size': 1} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-954877906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:16Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Creating volume 78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:54:15 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:54:15 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:15 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 1073741824 Jul 09 16:54:15 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-a6834d63-4b98-4b21-8fed-6faba3653035-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Lock "cinder-a6834d63-4b98-4b21-8fed-6faba3653035-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-b4cfda48-77c0-4068-9acd-b9f66bdb8218" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-b4cfda48-77c0-4068-9acd-b9f66bdb8218" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-a6834d63-4b98-4b21-8fed-6faba3653035" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a6834d63-4b98-4b21-8fed-6faba3653035" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Deleting offline snapshot a6834d63-4b98-4b21-8fed-6faba3653035 of volume b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] snapshot_file for this snap is: volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b64c0d-d59f-467d-af67-fc36f51cdd0d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:16 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 Jul 09 16:54:16 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:16 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 1073741824" returned: 0 in 0.841s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:16 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 Jul 09 16:54:16 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:16 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:16 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1635201-a68f-44db-bb01-6b618d0a6dbe]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:17 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 Jul 09 16:54:17 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:17 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" returned: 0 in 0.688s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac42feb3-30cd-460f-8ccf-171fa53c790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddeb75-f7e2-4155-bd2d-372f5db03a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:17 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Volume volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 (78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1): created successfully Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddeb75-f7e2-4155-bd2d-372f5db03a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (5cc143c3-67c1-4761-b3ef-2563d016648e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:17 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-b722b294-a8a1-4ac8-a51b-b26e898304a3 tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:54:17 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218" returned: 0 in 0.835s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:17 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 Jul 09 16:54:17 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:17 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Creating offline snapshot 50ed1f90-8d47-4ece-b7d2-d6290583d024 of volume 78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:54:18 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb3fe22-4a87-4305-8179-26c295e0598e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:18 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 Jul 09 16:54:18 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:18 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:18 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035 Jul 09 16:54:18 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:18 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" returned: 0 in 0.781s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:18 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:18 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 1G Jul 09 16:54:18 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:19 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218.a6834d63-4b98-4b21-8fed-6faba3653035" returned: 0 in 0.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a6834d63-4b98-4b21-8fed-6faba3653035" released by "_delete_snapshot" :: held 3.208s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-b4cfda48-77c0-4068-9acd-b9f66bdb8218" released by "delete_snapshot" :: held 3.234s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:19 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Created reservations ['2554a391-14f9-430e-b029-3345dec7c893', 'a307c442-6237-4e52-a478-016540794fc1', 'a34ced44-5c96-4439-a87b-9549f437be14', '29d417d7-bcd8-4560-8053-5ef04e893e3b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:19 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Delete snapshot completed successfully. Jul 09 16:54:19 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-91e60681-8ea7-4b13-b082-79eff05346db tempest-ProjectReaderTests-347065850 None] Lock "cinder-a6834d63-4b98-4b21-8fed-6faba3653035-delete_snapshot" released by "delete_snapshot" :: held 3.378s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:19 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 1G" returned: 0 in 0.830s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:19 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:19 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 Jul 09 16:54:19 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-b4cfda48-77c0-4068-9acd-b9f66bdb8218-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:20 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024" returned: 0 in 0.699s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:20 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 is being set with open permissions: ugo+rw Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Lock "cinder-b4cfda48-77c0-4068-9acd-b9f66bdb8218-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:20 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 Jul 09 16:54:20 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-b4cfda48-77c0-4068-9acd-b9f66bdb8218" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-b4cfda48-77c0-4068-9acd-b9f66bdb8218" acquired by "delete_volume" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb64fed5-e71b-449b-84cd-89ef6215f005]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:20 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 Jul 09 16:54:20 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:20 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:20 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024" returned: 0 in 0.663s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:21 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.info Jul 09 16:54:21 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:21 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218" returned: 0 in 0.757s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:21 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218 Jul 09 16:54:21 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:21 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.info" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:21 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.info is being set with open permissions: ugo+rw Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:21 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.info Jul 09 16:54:21 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:21 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-b4cfda48-77c0-4068-9acd-b9f66bdb8218" returned: 0 in 0.692s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-b4cfda48-77c0-4068-9acd-b9f66bdb8218" released by "delete_volume" :: held 1.505s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:21 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Created reservations ['0be28e1b-c70d-40ad-8236-1f9608e8c2d9', 'c68cfdbb-722c-4998-9a0d-3aeb4346cb03', 'a3f5055b-6939-4463-9924-3a4df32760c1', '0f93bbb9-e2a1-4fae-a63a-90f75c42449e'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:22 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:22 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:22 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.info" returned: 0 in 0.674s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-90e0c656-2fde-4840-8a94-f9c25ba248d2 tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:54:22 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.694s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:22 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Deleted volume successfully. Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f54d3d17-ad28-4228-b1c9-54fbd143ec6d tempest-ProjectReaderTests-347065850 None] Lock "cinder-b4cfda48-77c0-4068-9acd-b9f66bdb8218-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (e3cd7487-6d92-42ff-a9fa-26056468868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:22 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63991427-f7b7-4d95-8d4a-d8868298b70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63991427-f7b7-4d95-8d4a-d8868298b70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661020624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac4660a-ce6b-4738-bda9-c7a2c472da66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:23Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bc1cef-6b1e-4c1f-a1c6-6cfe6053dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bc1cef-6b1e-4c1f-a1c6-6cfe6053dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7707494b-92e5-49a0-b028-82d4eb1cf4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7707494b-92e5-49a0-b028-82d4eb1cf4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac4660a-ce6b-4738-bda9-c7a2c472da66', 'volume_name': 'volume-cac4660a-ce6b-4738-bda9-c7a2c472da66', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a72740-3f48-40a3-8b7b-1ec9e2dc65d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a72740-3f48-40a3-8b7b-1ec9e2dc65d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a17449-a91d-4517-9170-8ae76766df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:23 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Volume cac4660a-ce6b-4738-bda9-c7a2c472da66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac4660a-ce6b-4738-bda9-c7a2c472da66', 'volume_size': 1} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661020624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac4660a-ce6b-4738-bda9-c7a2c472da66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eed9086204e4f45b526fad05e200d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:23Z,use_quota=True,user_id='cc3593d0cd304d90a2b5690a132a4007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Creating volume cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:54:23 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:23 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 1073741824 Jul 09 16:54:23 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-50ed1f90-8d47-4ece-b7d2-d6290583d024-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Lock "cinder-50ed1f90-8d47-4ece-b7d2-d6290583d024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-50ed1f90-8d47-4ece-b7d2-d6290583d024" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-50ed1f90-8d47-4ece-b7d2-d6290583d024" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot 50ed1f90-8d47-4ece-b7d2-d6290583d024 of volume 78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f638c86b-bf28-4154-8235-382721f3363c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:23 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 Jul 09 16:54:23 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:23 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 1073741824" returned: 0 in 0.804s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:23 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:23 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 Jul 09 16:54:23 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:24 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024" returned: 0 in 0.760s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[51102c1b-7c93-4cbc-bf7b-97bb9d54aa34]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:24 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 Jul 09 16:54:24 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:24 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66" returned: 0 in 0.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a17449-a91d-4517-9170-8ae76766df4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac4660a-ce6b-4738-bda9-c7a2c472da66', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28e059-b221-489d-be24-0d0780ab5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:24 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Volume volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 (cac4660a-ce6b-4738-bda9-c7a2c472da66): created successfully Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e28e059-b221-489d-be24-0d0780ab5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Flow 'volume_create_manager' (e3cd7487-6d92-42ff-a9fa-26056468868e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:24 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4db3597b-c6cb-40a1-9a60-1d93c5a56478 tempest-ProjectReaderTests-347065850 None] Created volume successfully. Jul 09 16:54:24 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:24 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:24 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 Jul 09 16:54:24 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:25 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Creating offline snapshot a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 of volume cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:54:25 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f492ff5-9425-4225-b3cf-099cc7983776]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:25 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 Jul 09 16:54:25 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:25 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024" returned: 0 in 0.726s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:25 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:25 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024 Jul 09 16:54:25 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:26 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66" returned: 0 in 0.745s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:26 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 1G Jul 09 16:54:26 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:26 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1.50ed1f90-8d47-4ece-b7d2-d6290583d024" returned: 0 in 0.658s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-50ed1f90-8d47-4ece-b7d2-d6290583d024" released by "_delete_snapshot" :: held 3.007s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" released by "delete_snapshot" :: held 3.034s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Created reservations ['ce6ef42f-777a-4c4a-808c-81b6bfaface3', '734b8c1e-e16d-4cda-8f77-cf8b529cd5f9', '23cbaece-84fe-4be8-a490-7e6112078794', '6ea86910-e5e2-4265-bd52-8e9a5632d6e4'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:26 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-4d5427eb-b273-4a04-8e25-e0c1945fd386 tempest-ProjectMemberTests-974675878 None] Lock "cinder-50ed1f90-8d47-4ece-b7d2-d6290583d024-delete_snapshot" released by "delete_snapshot" :: held 3.206s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:26 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 1G" returned: 0 in 0.791s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:26 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:26 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 Jul 09 16:54:26 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Lock "cinder-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:27 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:27 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 is being set with open permissions: ugo+rw Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bdbff8-3911-4b12-b5d0-388ad4be7390]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:27 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:27 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 Jul 09 16:54:27 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:27 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 Jul 09 16:54:27 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:28 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" returned: 0 in 0.652s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:28 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.info Jul 09 16:54:28 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:28 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:28 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1 Jul 09 16:54:28 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:28 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:28 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:28 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.info" returned: 0 in 0.652s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:28 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.info is being set with open permissions: ugo+rw Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:28 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.info Jul 09 16:54:28 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:28 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" returned: 0 in 0.654s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:28 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1" released by "delete_volume" :: held 1.482s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Created reservations ['c2c69321-ae66-455e-b455-178c0ba4e535', '311eadab-ad90-49e7-960a-45c00a87badd', '9c304b16-6409-497d-bb7e-8a179729216c', 'ba670bda-9c9a-4a18-86db-2ed9be0ca758'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:29 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:29 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:29 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.672s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:54:29 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.info" returned: 0 in 0.637s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.301s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ec97bcbd-ac14-4cd3-a07b-b9aacff3447e tempest-ProjectReaderTests-347065850 None] Create snapshot completed successfully Jul 09 16:54:29 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:29 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:54:29 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e98027f0-994a-481d-b3a4-ca763ec35cb2 tempest-ProjectMemberTests-974675878 None] Lock "cinder-78e21fbe-7f8c-4095-bf08-3c2fcdf7bcc1-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (214699b1-73ba-4527-a463-024b032dfdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af98e0-3325-4576-9bf2-f18a18c1d5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af98e0-3325-4576-9bf2-f18a18c1d5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575084957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a876e7-86be-4c8d-b4ed-19a448395151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:30Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644088c8-917c-40df-8b5f-b3cdd565be44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644088c8-917c-40df-8b5f-b3cdd565be44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bd3fb1-a22d-4771-8cc5-14ad1d69c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bd3fb1-a22d-4771-8cc5-14ad1d69c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a876e7-86be-4c8d-b4ed-19a448395151', 'volume_name': 'volume-05a876e7-86be-4c8d-b4ed-19a448395151', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa02fe6-edb1-4a90-9980-0742981677e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa02fe6-edb1-4a90-9980-0742981677e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5cf3d4-6e36-43da-8646-023573d03f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:30 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Volume 05a876e7-86be-4c8d-b4ed-19a448395151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a876e7-86be-4c8d-b4ed-19a448395151', 'volume_size': 1} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575084957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a876e7-86be-4c8d-b4ed-19a448395151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:30Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Creating volume 05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:54:30 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:30 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 1073741824 Jul 09 16:54:30 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Lock "cinder-a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-cac4660a-ce6b-4738-bda9-c7a2c472da66" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-cac4660a-ce6b-4738-bda9-c7a2c472da66" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Deleting offline snapshot a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 of volume cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] snapshot_file for this snap is: volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d77fda-bc9c-4897-9819-db720392d507]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:30 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 Jul 09 16:54:30 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:30 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:30 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 1073741824" returned: 0 in 0.807s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:31 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 Jul 09 16:54:31 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:31 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" returned: 0 in 0.772s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac4660a-ce6b-4738-bda9-c7a2c472da66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b4bad9-870a-44f9-a408-97b5c4dfe400]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:31 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 Jul 09 16:54:31 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:31 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151" returned: 0 in 0.662s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5cf3d4-6e36-43da-8646-023573d03f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a876e7-86be-4c8d-b4ed-19a448395151', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc45064-eacb-443e-98bd-0634ab40b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:31 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Volume volume-05a876e7-86be-4c8d-b4ed-19a448395151 (05a876e7-86be-4c8d-b4ed-19a448395151): created successfully Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc45064-eacb-443e-98bd-0634ab40b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:31 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (214699b1-73ba-4527-a463-024b032dfdb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:31 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-68a37b0e-5bc4-4b32-ba86-34753dc09783 tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:54:32 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66" returned: 0 in 0.763s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:32 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 Jul 09 16:54:32 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Creating offline snapshot 8aa79176-41c8-4489-af05-7adad04a7514 of volume 05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e009091-646e-4bb8-91f7-f0b1dc9cb812]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:32 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 Jul 09 16:54:32 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:32 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" returned: 0 in 0.741s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:32 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:32 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3 Jul 09 16:54:32 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:33 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151" returned: 0 in 0.771s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:33 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 1G Jul 09 16:54:33 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:33 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66.a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" returned: 0 in 0.683s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3" released by "_delete_snapshot" :: held 3.064s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-cac4660a-ce6b-4738-bda9-c7a2c472da66" released by "delete_snapshot" :: held 3.088s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Created reservations ['c54cdbe4-9f99-4abb-8463-36634af60236', 'c0df45f4-982d-4a66-88e0-e9cba307e857', 'e67b46ee-808a-4409-b6a8-fff98ec2c100', 'd10cfb1b-deba-47c2-bcaf-02746259f6c5'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:33 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Delete snapshot completed successfully. Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-ed482319-e8ee-4602-b3fe-c1d8f8986af6 tempest-ProjectReaderTests-347065850 None] Lock "cinder-a9aa3c43-2c76-415a-b6c8-d5a60e7abaa3-delete_snapshot" released by "delete_snapshot" :: held 3.235s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:33 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:33 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 1G" returned: 0 in 0.838s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a876e7-86be-4c8d-b4ed-19a448395151 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:34 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a876e7-86be-4c8d-b4ed-19a448395151 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 Jul 09 16:54:34 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:34 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-cac4660a-ce6b-4738-bda9-c7a2c472da66-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a876e7-86be-4c8d-b4ed-19a448395151 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514" returned: 0 in 0.715s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:34 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 is being set with open permissions: ugo+rw Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Lock "cinder-cac4660a-ce6b-4738-bda9-c7a2c472da66-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:34 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 Jul 09 16:54:34 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Acquiring lock "cinder-quobyte-cac4660a-ce6b-4738-bda9-c7a2c472da66" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-cac4660a-ce6b-4738-bda9-c7a2c472da66" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a43a552-7fbe-4b03-becd-aa03eb8fbc5d]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:34 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:34 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 Jul 09 16:54:34 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:35 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514" returned: 0 in 0.690s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:35 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.info Jul 09 16:54:35 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:35 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66" returned: 0 in 0.754s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:35 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:35 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66 Jul 09 16:54:35 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:36 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.info" returned: 0 in 0.676s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:36 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.info is being set with open permissions: ugo+rw Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:36 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.info Jul 09 16:54:36 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:36 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cac4660a-ce6b-4738-bda9-c7a2c472da66" returned: 0 in 0.650s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Lock "cinder-quobyte-cac4660a-ce6b-4738-bda9-c7a2c472da66" released by "delete_volume" :: held 1.461s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Created reservations ['9a1ebd68-84f6-4ed9-ae83-9f213692799e', '6f2acbd9-40ce-4269-8c54-ecc1abd217ff', '7d83e1ee-5625-49b3-8514-95c90f4060d0', '4fe94cbe-d7e6-49d7-bb94-e241edbb6a52'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:36 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:36 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:36 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.info" returned: 0 in 0.686s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:36 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.468s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:36 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fff6bc64-22b6-46a6-906e-dd8c8b8d8a6c tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:54:37 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.652s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:37 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Deleted volume successfully. Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-9c31cb51-009d-4ed8-8391-98daa6e9ad83 tempest-ProjectReaderTests-347065850 None] Lock "cinder-cac4660a-ce6b-4738-bda9-c7a2c472da66-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-8aa79176-41c8-4489-af05-7adad04a7514-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Lock "cinder-8aa79176-41c8-4489-af05-7adad04a7514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-05a876e7-86be-4c8d-b4ed-19a448395151" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-05a876e7-86be-4c8d-b4ed-19a448395151" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-8aa79176-41c8-4489-af05-7adad04a7514" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-8aa79176-41c8-4489-af05-7adad04a7514" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot 8aa79176-41c8-4489-af05-7adad04a7514 of volume 05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[f467952b-fc8a-403a-a3ba-aed58b3f3344]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:37 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:37 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 Jul 09 16:54:37 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:38 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514" returned: 0 in 0.833s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05a876e7-86be-4c8d-b4ed-19a448395151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:54:38 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ecb368-5cc4-4dc0-88a3-91c272d30227]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:38 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 Jul 09 16:54:38 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:39 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151" returned: 0 in 0.768s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:39 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 Jul 09 16:54:39 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:40 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514" returned: 0 in 0.778s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:40 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514 Jul 09 16:54:40 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:40 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151.8aa79176-41c8-4489-af05-7adad04a7514" returned: 0 in 0.638s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-8aa79176-41c8-4489-af05-7adad04a7514" released by "_delete_snapshot" :: held 3.111s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-05a876e7-86be-4c8d-b4ed-19a448395151" released by "delete_snapshot" :: held 3.133s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:40 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Created reservations ['aa118082-9f19-4e8d-bafc-b8d67192e8bb', 'f6faf65d-61c7-4c18-8483-f132a973a94d', 'b131fe3c-caa7-4638-aa74-f4d2e2bbbfb2', '4cf466e1-172b-4834-b539-3dcf836acfd6'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:54:40 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-19bb603f-21e7-4eb7-aae3-53ed018a54d0 tempest-ProjectMemberTests-974675878 None] Lock "cinder-8aa79176-41c8-4489-af05-7adad04a7514-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-05a876e7-86be-4c8d-b4ed-19a448395151-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Lock "cinder-05a876e7-86be-4c8d-b4ed-19a448395151-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-05a876e7-86be-4c8d-b4ed-19a448395151" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:41 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-05a876e7-86be-4c8d-b4ed-19a448395151" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:41 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642500e-dd46-4e0c-b7a6-d607e4ad510a]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:42 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 Jul 09 16:54:42 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:42 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151" returned: 0 in 0.732s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:42 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151 Jul 09 16:54:42 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:43 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-05a876e7-86be-4c8d-b4ed-19a448395151" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-05a876e7-86be-4c8d-b4ed-19a448395151" released by "delete_volume" :: held 1.468s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=118,cinder:INSERT=49,cinder:UPDATE=170,cinder:DELETE=11 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:DELETE=17,cinder:UPDATE=158,cinder:SELECT=129,cinder:INSERT=40 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Created reservations ['3ab19485-1269-4b25-a1b3-bab2c5b4e6f9', '85c581f5-37ac-4605-bec4-0a18d3bcd7e6', '916836f6-ca5b-4bb0-9352-d92cfcea93cc', '91e7b744-717f-47ef-87cc-16afa1a68c94'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:43 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:43 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:44 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.655s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-75b4064a-b2f4-452f-8469-d3bcdd752ad1 tempest-ProjectMemberTests-974675878 None] Lock "cinder-05a876e7-86be-4c8d-b4ed-19a448395151-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (590c0552-fe6b-430f-a030-e696c6377e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047dc8f6-a6ad-4835-918d-2eab5a3da253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047dc8f6-a6ad-4835-918d-2eab5a3da253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217787945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd201925-9f4f-4996-826d-606d8b771c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:44Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe40f10-65ac-450e-9d46-b8f0771d7ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe40f10-65ac-450e-9d46-b8f0771d7ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a6722a-f640-489f-bac3-e4bb8c42df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a6722a-f640-489f-bac3-e4bb8c42df42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd201925-9f4f-4996-826d-606d8b771c76', 'volume_name': 'volume-cd201925-9f4f-4996-826d-606d8b771c76', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210ef645-c718-4479-9e2b-15aee8a09dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210ef645-c718-4479-9e2b-15aee8a09dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75780f24-2760-4116-a7a5-a956eef3d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:44 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Volume cd201925-9f4f-4996-826d-606d8b771c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd201925-9f4f-4996-826d-606d8b771c76', 'volume_size': 1} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217787945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd201925-9f4f-4996-826d-606d8b771c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:44Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Creating volume cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:54:44 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:54:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:44 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 1073741824 Jul 09 16:54:44 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:45 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 1073741824" returned: 0 in 0.860s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:45 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:45 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 Jul 09 16:54:45 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:46 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76" returned: 0 in 0.655s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75780f24-2760-4116-a7a5-a956eef3d260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd201925-9f4f-4996-826d-606d8b771c76', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2125765f-740d-4d78-b84f-3f7ed022b79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Volume volume-cd201925-9f4f-4996-826d-606d8b771c76 (cd201925-9f4f-4996-826d-606d8b771c76): created successfully Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2125765f-740d-4d78-b84f-3f7ed022b79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (590c0552-fe6b-430f-a030-e696c6377e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:46 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-fedc196e-8b98-4473-8037-4106c0cda050 tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Creating offline snapshot bef76b07-238c-4f70-a7df-fef9bfe3ccbb of volume cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beaaa17-4ac0-491f-a9b3-64a6c7908887]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:46 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 Jul 09 16:54:46 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:47 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76" returned: 0 in 0.827s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:47 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb 1G Jul 09 16:54:47 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:48 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb 1G" returned: 0 in 0.900s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd201925-9f4f-4996-826d-606d8b771c76 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:48 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd201925-9f4f-4996-826d-606d8b771c76 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb Jul 09 16:54:48 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:49 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd201925-9f4f-4996-826d-606d8b771c76 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb" returned: 0 in 0.719s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:49 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb is being set with open permissions: ugo+rw Jul 09 16:54:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:49 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb Jul 09 16:54:49 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:49 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb" returned: 0 in 0.688s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:49 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:49 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.info Jul 09 16:54:49 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:50 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.info" returned: 0 in 0.683s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:50 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.info is being set with open permissions: ugo+rw Jul 09 16:54:50 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:50 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.info Jul 09 16:54:50 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:51 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.info" returned: 0 in 0.627s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:51 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.535s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:51 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-88bed1ad-b1ca-4b66-8f78-8d8e8080623c tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:54:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-bef76b07-238c-4f70-a7df-fef9bfe3ccbb-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:51 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Lock "cinder-bef76b07-238c-4f70-a7df-fef9bfe3ccbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-cd201925-9f4f-4996-826d-606d8b771c76" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-cd201925-9f4f-4996-826d-606d8b771c76" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-bef76b07-238c-4f70-a7df-fef9bfe3ccbb" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-bef76b07-238c-4f70-a7df-fef9bfe3ccbb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot bef76b07-238c-4f70-a7df-fef9bfe3ccbb of volume cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804bb4e-2062-4766-9aad-fe252cb5e13b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:52 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb Jul 09 16:54:52 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:52 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb" returned: 0 in 0.790s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd201925-9f4f-4996-826d-606d8b771c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e92f03-f34c-4d03-b472-b5e03bc88a2f]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:53 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 Jul 09 16:54:53 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:53 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76" returned: 0 in 0.800s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:53 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb Jul 09 16:54:53 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:54 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb" returned: 0 in 0.765s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:54 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:54 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb Jul 09 16:54:54 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:55 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76.bef76b07-238c-4f70-a7df-fef9bfe3ccbb" returned: 0 in 0.678s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-bef76b07-238c-4f70-a7df-fef9bfe3ccbb" released by "_delete_snapshot" :: held 3.137s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-cd201925-9f4f-4996-826d-606d8b771c76" released by "delete_snapshot" :: held 3.163s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:55 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Created reservations ['b8593148-6320-44ea-8a0d-cd1f1d007aa1', 'a28df6d8-eff3-4ef6-a7ba-eba0c197aa79', 'e49d2901-dae3-4b82-9cfd-e4d77012e075', '08dd62c5-f96f-419c-96ec-7364481c4367'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:55 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:54:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-21de112c-39af-49e3-8739-7e2ef7b3bc4c tempest-ProjectMemberTests-974675878 None] Lock "cinder-bef76b07-238c-4f70-a7df-fef9bfe3ccbb-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-cd201925-9f4f-4996-826d-606d8b771c76-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Lock "cinder-cd201925-9f4f-4996-826d-606d8b771c76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-cd201925-9f4f-4996-826d-606d8b771c76" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:54:56 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-cd201925-9f4f-4996-826d-606d8b771c76" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:54:56 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[95052c7e-bcce-445e-8d4e-17f3d86aacc3]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:54:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:56 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 Jul 09 16:54:56 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:57 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76" returned: 0 in 0.740s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:57 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76 Jul 09 16:54:57 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:57 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd201925-9f4f-4996-826d-606d8b771c76" returned: 0 in 0.628s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-cd201925-9f4f-4996-826d-606d8b771c76" released by "delete_volume" :: held 1.425s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Created reservations ['f7ea9674-9d2c-437e-b7df-617d09bb6043', 'd3d354a8-7f7d-44de-abd6-215b645469da', 'b68b1f95-be16-43e3-b843-25f92d127335', '301cb9df-c74e-4a9c-ad6d-72689f1e5d77'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:57 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:54:57 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:58 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.650s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:54:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-99fb7b36-75c6-4cc7-a9e3-39e71b7558cc tempest-ProjectMemberTests-974675878 None] Lock "cinder-cd201925-9f4f-4996-826d-606d8b771c76-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (df228c50-9844-4e65-870b-f7dd1bc3df82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaf2c9f-d173-4331-8485-45c6a0782ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaf2c9f-d173-4331-8485-45c6a0782ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1589506754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5975a0-df2f-44cc-9f65-3638a7fe07c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:59Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783e4749-6675-48ca-9f72-12d29223fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783e4749-6675-48ca-9f72-12d29223fd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dc1e81-6681-4a81-8917-076dbcd58b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dc1e81-6681-4a81-8917-076dbcd58b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5975a0-df2f-44cc-9f65-3638a7fe07c5', 'volume_name': 'volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5e6b6d-f8e9-4d7f-a3bf-45f200a8c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5e6b6d-f8e9-4d7f-a3bf-45f200a8c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105480a8-0bbf-4d8f-9deb-f605fbc5d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:54:58 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Volume 8d5975a0-df2f-44cc-9f65-3638a7fe07c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5', 'volume_size': 1} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1589506754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5975a0-df2f-44cc-9f65-3638a7fe07c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d57f07c5fec46e58a72f14be3066ed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:54:59Z,use_quota=True,user_id='c7029dcda51249238d05b92ad36623ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Creating volume 8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:54:58 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:54:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:58 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 1073741824 Jul 09 16:54:58 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:54:59 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 09 16:54:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 1073741824" returned: 0 in 0.805s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:54:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:54:59 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 Jul 09 16:54:59 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:00 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" returned: 0 in 0.620s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:00 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:55:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105480a8-0bbf-4d8f-9deb-f605fbc5d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f3049-fa44-4bad-b8aa-3d7c245a1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:00 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Volume volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 (8d5975a0-df2f-44cc-9f65-3638a7fe07c5): created successfully Jul 09 16:55:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f3049-fa44-4bad-b8aa-3d7c245a1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:00 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Flow 'volume_create_manager' (df228c50-9844-4e65-870b-f7dd1bc3df82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:55:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-27320eca-bfa8-4160-91e1-75001f8ab6b7 tempest-ProjectMemberTests-974675878 None] Created volume successfully. Jul 09 16:55:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:01 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Creating offline snapshot 40b1e38e-add3-492c-918c-1da1cc7ad21b of volume 8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:55:01 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec22d7d2-682a-4b6b-b107-a36da2cd1c10]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:01 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 Jul 09 16:55:01 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:01 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" returned: 0 in 0.726s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:01 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b 1G Jul 09 16:55:01 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:02 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b 1G" returned: 0 in 0.776s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:02 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b Jul 09 16:55:02 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:03 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b" returned: 0 in 0.677s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:03 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b is being set with open permissions: ugo+rw Jul 09 16:55:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:03 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b Jul 09 16:55:03 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:03 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b" returned: 0 in 0.633s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:03 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:03 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.info Jul 09 16:55:03 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:04 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.info" returned: 0 in 0.641s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:04 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.info is being set with open permissions: ugo+rw Jul 09 16:55:04 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:04 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.info Jul 09 16:55:04 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:05 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.info" returned: 0 in 0.633s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:05 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:05 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-a06b4a67-c37f-4ce0-b3ba-369fcdee7a18 tempest-ProjectMemberTests-974675878 None] Create snapshot completed successfully Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-40b1e38e-add3-492c-918c-1da1cc7ad21b-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Lock "cinder-40b1e38e-add3-492c-918c-1da1cc7ad21b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-40b1e38e-add3-492c-918c-1da1cc7ad21b" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-40b1e38e-add3-492c-918c-1da1cc7ad21b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Deleting offline snapshot 40b1e38e-add3-492c-918c-1da1cc7ad21b of volume 8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] snapshot_file for this snap is: volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd9b5a-2369-48b0-ae65-d6353284ae6e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:06 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:06 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b Jul 09 16:55:06 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:07 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b" returned: 0 in 0.750s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:07 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:55:07 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff62904-2c8d-4da1-af23-82fb1011c988]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:07 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 Jul 09 16:55:07 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:07 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" returned: 0 in 0.733s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:07 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:07 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b Jul 09 16:55:07 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:08 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b" returned: 0 in 0.708s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:08 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:08 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b Jul 09 16:55:08 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:09 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5.40b1e38e-add3-492c-918c-1da1cc7ad21b" returned: 0 in 0.619s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-40b1e38e-add3-492c-918c-1da1cc7ad21b" released by "_delete_snapshot" :: held 2.899s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" released by "delete_snapshot" :: held 2.921s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Created reservations ['62af5e57-1a28-48d5-bf2d-860acda66119', '513eccb0-42c9-4b5b-b4db-44777b05c8cb', 'e7e7e297-4014-48ab-acc5-1297c89620f9', 'd86f3e82-7f99-4a88-a2ed-887421dade57'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:55:09 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Delete snapshot completed successfully. Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-96b9b61e-97ea-4347-b8bd-47628e871134 tempest-ProjectMemberTests-974675878 None] Lock "cinder-40b1e38e-add3-492c-918c-1da1cc7ad21b-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-8d5975a0-df2f-44cc-9f65-3638a7fe07c5-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-8d5975a0-df2f-44cc-9f65-3638a7fe07c5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Acquiring lock "cinder-quobyte-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" acquired by "delete_volume" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b63e80-33a7-403e-967e-15731e33e88c]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:09 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:09 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 Jul 09 16:55:09 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:10 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" returned: 0 in 0.732s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:10 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5 Jul 09 16:55:10 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:10 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:10 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" returned: 0 in 0.626s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:10 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-quobyte-8d5975a0-df2f-44cc-9f65-3638a7fe07c5" released by "delete_volume" :: held 1.411s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Created reservations ['cc6f3ba2-50bd-446b-8d48-e15eeda89229', 'cdc9c5d7-edce-43f8-90fc-db539a2a0e17', 'd6e94eab-025e-4106-a039-2529cba807d5', '3ac7db08-8347-4b88-ac49-049ae7935d6c'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:11 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:55:11 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:11 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.618s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:55:11 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Deleted volume successfully. Jul 09 16:55:11 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-f134cf53-b536-479b-b14e-10a87037ad57 tempest-ProjectMemberTests-974675878 None] Lock "cinder-8d5975a0-df2f-44cc-9f65-3638a7fe07c5-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:21 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=35,cinder:INSERT=10,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:55:21 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:INSERT=14,cinder:UPDATE=43,cinder:SELECT=27,cinder:DELETE=3 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:55:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:55:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:55:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:55:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:28 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:55:28 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:29 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.698s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:55:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:55:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:55:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Flow 'volume_create_manager' (dc8daf14-d8a9-4acb-82e5-f8953c78e476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb839b94-f255-406c-a8ef-2ddd02586f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb839b94-f255-406c-a8ef-2ddd02586f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795419771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb9658606f340fb97dd2de8573f35c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:55:38Z,use_quota=True,user_id='7ea775708b06481b9bbd1ac8ab97394b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004470aa-9bde-4f5e-8302-33d69aed7628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004470aa-9bde-4f5e-8302-33d69aed7628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350073ca-3e81-4ae7-8afd-e77e24b0627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350073ca-3e81-4ae7-8afd-e77e24b0627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0', 'volume_name': 'volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c6ae07-e86a-49f8-b538-01992dd37984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c6ae07-e86a-49f8-b538-01992dd37984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b838a0a-507f-42e8-a5ae-46673ba53874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:38 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Volume cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0', 'volume_size': 1} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795419771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb9658606f340fb97dd2de8573f35c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:55:38Z,use_quota=True,user_id='7ea775708b06481b9bbd1ac8ab97394b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)}" {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Creating volume cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:55:38 devstack cinder-volume[87204]: INFO cinder.volume.drivers.remotefs [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] casted to osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 Jul 09 16:55:38 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 1073741824 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:38 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 1073741824 Jul 09 16:55:38 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:39 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 1073741824" returned: 0 in 0.785s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:39 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 Jul 09 16:55:39 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:39 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" returned: 0 in 0.655s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:39 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'} {{(pid=87204) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 16:55:39 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b838a0a-507f-42e8-a5ae-46673ba53874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0', 'volume_size': 1}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:39 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19faf4b-7f23-4b70-9003-219ffb2a24cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:39 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Volume volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 (cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0): created successfully Jul 09 16:55:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19faf4b-7f23-4b70-9003-219ffb2a24cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:40 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Flow 'volume_create_manager' (dc8daf14-d8a9-4acb-82e5-f8953c78e476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:55:40 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-089f393e-908a-4124-8a60-80bb4439db21 tempest-SnapshotDependencyTests-693631100 None] Created volume successfully. Jul 09 16:55:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:40 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Creating offline snapshot d56d4098-cf56-4a09-b834-402f3d36f731 of volume cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 16:55:40 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[33967979-2f30-400e-a883-5065beb1cd42]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:40 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:40 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 Jul 09 16:55:40 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:41 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" returned: 0 in 0.752s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:41 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 1G {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:41 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 1G Jul 09 16:55:41 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:42 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 1G" returned: 0 in 0.779s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:42 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 Jul 09 16:55:42 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:42 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 -F qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731" returned: 0 in 0.712s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:42 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 is being set with open permissions: ugo+rw Jul 09 16:55:42 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:42 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 Jul 09 16:55:42 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:43 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731" returned: 0 in 0.618s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:43 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:43 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.info Jul 09 16:55:43 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:44 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.info" returned: 0 in 0.633s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:44 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.info is being set with open permissions: ugo+rw Jul 09 16:55:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.info {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:44 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.info Jul 09 16:55:44 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:44 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.info" returned: 0 in 0.634s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:44 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.211s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:44 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-21a328da-9113-4104-adb8-379de53b11a7 tempest-SnapshotDependencyTests-693631100 None] Create snapshot completed successfully Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.flows.manager.create_volume [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87204) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Flow 'volume_create_manager' (fa625281-4781-4b4e-b6a6-e975cb70d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7572fb-9d79-41e7-8720-78023d2fa339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7572fb-9d79-41e7-8720-78023d2fa339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T14:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befc34fc-51f2-4f80-b031-e78a295fc638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb9658606f340fb97dd2de8573f35c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T14:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d56d4098-cf56-4a09-b834-402f3d36f731,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T14:55:46Z,use_quota=True,user_id='7ea775708b06481b9bbd1ac8ab97394b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6),volume_type_id=7b6cf61b-8ad9-4a30-b0ec-56ef9232dfc6)' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c382278-ba32-4646-81c6-3f3049e276dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c382278-ba32-4646-81c6-3f3049e276dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f8c59b-9c21-4e66-b0a0-54e83d05a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f8c59b-9c21-4e66-b0a0-54e83d05a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'befc34fc-51f2-4f80-b031-e78a295fc638', 'volume_name': 'volume-befc34fc-51f2-4f80-b031-e78a295fc638', 'volume_size': 1, 'snapshot_id': 'd56d4098-cf56-4a09-b834-402f3d36f731'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef0ba2d-a1a4-4c89-9006-091914d1f2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef0ba2d-a1a4-4c89-9006-091914d1f2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d5a75b-1456-4582-b9b0-5d28ba39b014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:46 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Volume befc34fc-51f2-4f80-b031-e78a295fc638: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-befc34fc-51f2-4f80-b031-e78a295fc638', 'volume_size': 1, 'snapshot_id': 'd56d4098-cf56-4a09-b834-402f3d36f731'} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-quobyte-d56d4098-cf56-4a09-b834-402f3d36f731-befc34fc-51f2-4f80-b031-e78a295fc638" by "_create_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-d56d4098-cf56-4a09-b834-402f3d36f731-befc34fc-51f2-4f80-b031-e78a295fc638" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Creating volume befc34fc-51f2-4f80-b031-e78a295fc638 from snapshot d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Selected osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31 as target Quobyte volume. {{(pid=87204) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-quobyte-befc34fc-51f2-4f80-b031-e78a295fc638" by "_copy_volume_from_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-befc34fc-51f2-4f80-b031-e78a295fc638" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] snapshot: d56d4098-cf56-4a09-b834-402f3d36f731, volume: befc34fc-51f2-4f80-b031-e78a295fc638, {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[db51f9a5-1516-49fd-90c7-2c03fc49067e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:46 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:46 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 Jul 09 16:55:46 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:47 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731" returned: 0 in 0.717s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:55:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] will copy from snapshot at /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 16:55:47 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Creating direct copy from snapshot {{(pid=87204) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 16:55:47 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f58f066-7ebd-45f2-87cc-cd3628f05017]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:47 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:47 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 Jul 09 16:55:47 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:48 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" returned: 0 in 0.744s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:48 devstack cinder-volume[87204]: DEBUG cinder.utils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Path /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 not found in is_blk_device check {{(pid=87204) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 16:55:48 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:48 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 Jul 09 16:55:48 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:52 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638" returned: 0 in 4.257s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:52 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00d813-ffa2-4766-9963-5b50c6334a7b]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:52 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:52 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 Jul 09 16:55:52 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:53 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" returned: 0 in 0.907s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG cinder.image.image_utils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Image conversion details: src /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 {{(pid=87204) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 16:55:53 devstack cinder-volume[87204]: INFO cinder.image.image_utils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Converted 1024.00 MB image at 240.44 MB/s Jul 09 16:55:53 devstack cinder-volume[87204]: WARNING cinder.volume.drivers.remotefs [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 is being set with open permissions: ugo+rw Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:53 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 Jul 09 16:55:53 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:53 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638" returned: 0 in 0.632s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-befc34fc-51f2-4f80-b031-e78a295fc638" released by "_copy_volume_from_snapshot" :: held 7.353s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-d56d4098-cf56-4a09-b834-402f3d36f731-befc34fc-51f2-4f80-b031-e78a295fc638" released by "_create_volume_from_snapshot" :: held 7.378s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.392s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d5a75b-1456-4582-b9b0-5d28ba39b014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-befc34fc-51f2-4f80-b031-e78a295fc638', 'volume_size': 1, 'snapshot_id': 'd56d4098-cf56-4a09-b834-402f3d36f731'}' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0029e28-29ae-43dd-95f1-55dbe5b7f37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 16:55:53 devstack cinder-volume[87204]: INFO cinder.volume.flows.manager.create_volume [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Volume volume-befc34fc-51f2-4f80-b031-e78a295fc638 (befc34fc-51f2-4f80-b031-e78a295fc638): created successfully Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0029e28-29ae-43dd-95f1-55dbe5b7f37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87204) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 16:55:53 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Flow 'volume_create_manager' (fa625281-4781-4b4e-b6a6-e975cb70d400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87204) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 16:55:53 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-726530fe-54d7-4aba-b0cd-3c1f8757f036 tempest-SnapshotDependencyTests-693631100 None] Created volume successfully. Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-d56d4098-cf56-4a09-b834-402f3d36f731-delete_snapshot" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-d56d4098-cf56-4a09-b834-402f3d36f731-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-quobyte-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" by "delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-quobyte-d56d4098-cf56-4a09-b834-402f3d36f731" by "_delete_snapshot" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-d56d4098-cf56-4a09-b834-402f3d36f731" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Deleting offline snapshot d56d4098-cf56-4a09-b834-402f3d36f731 of volume cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] snapshot_file for this snap is: volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d6a9ba-3d44-4f6f-bd22-eda275a8733e]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:55 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 Jul 09 16:55:55 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:55 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731" returned: 0 in 0.743s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.remotefs [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87204) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b3b164-c1eb-4324-8ff3-437a2832aaa9]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:55 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:55 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 Jul 09 16:55:55 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:56 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" returned: 0 in 0.731s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:56 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:56 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 Jul 09 16:55:56 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:57 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731" returned: 0 in 0.700s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:57 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731 Jul 09 16:55:57 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:57 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:57 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0.d56d4098-cf56-4a09-b834-402f3d36f731" returned: 0 in 0.622s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-d56d4098-cf56-4a09-b834-402f3d36f731" released by "_delete_snapshot" :: held 2.887s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:57 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" released by "delete_snapshot" :: held 2.907s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Created reservations ['8c795465-46ae-4651-96da-0a27daca00eb', '82124a5d-02b3-4adb-9a72-605c732addf3', '613db322-45e2-4d84-ac51-3a4c24bb90d7', 'c31bb675-4d1c-4f66-bc8a-481d4b27e59d'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:55:58 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Delete snapshot completed successfully. Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-e793073a-bf09-4284-bdc7-4df2705c2adb tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-d56d4098-cf56-4a09-b834-402f3d36f731-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-quobyte-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" acquired by "delete_volume" :: waited 0.014s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[381eeb94-830e-41bf-8d22-72ae4555a6a5]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:55:58 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:58 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 Jul 09 16:55:58 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:59 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" returned: 0 in 0.732s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:59 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0 Jul 09 16:55:59 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:55:59 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" returned: 0 in 0.632s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0" released by "delete_volume" :: held 1.418s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Created reservations ['41738b28-6522-4c21-8cba-55990daa3a57', '2e024c95-11e8-4246-8a81-2e657e85f2aa', '3dda78b6-9f9b-41e7-bb25-f4b2ca7479d9', 'c25af317-5f41-4a44-a976-bc18a7a38783'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:55:59 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:55:59 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:55:59 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-befc34fc-51f2-4f80-b031-e78a295fc638-delete_volume" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:56:00 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.640s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:56:00 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Deleted volume successfully. Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-befc34fc-51f2-4f80-b031-e78a295fc638-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-83c8dfb1-ac4a-454f-913d-9118303268c5 tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-cd1814c6-0c6b-4989-9dc8-0b7d34cdeea0-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "cinder-quobyte-befc34fc-51f2-4f80-b031-e78a295fc638" by "delete_volume" {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-befc34fc-51f2-4f80-b031-e78a295fc638" acquired by "delete_volume" :: waited 0.016s {{(pid=87204) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e13fad6-cf77-4e9b-bfd0-542429b35d43]: (4, 'qcow2') {{(pid=88262) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 16:56:00 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:00 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 Jul 09 16:56:00 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:01 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638" returned: 0 in 0.759s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:01 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638 Jul 09 16:56:01 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:01 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:01 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5/volume-befc34fc-51f2-4f80-b031-e78a295fc638" returned: 0 in 0.631s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:01 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-quobyte-befc34fc-51f2-4f80-b031-e78a295fc638" released by "delete_volume" :: held 1.428s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:56:01 devstack cinder-volume[87204]: DEBUG cinder.quota [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Created reservations ['582abc16-49a0-4144-aca4-e56806317318', '0a963064-e318-4ba9-8b5e-acf98aeda3dd', 'd6be83ff-807a-4b3f-bab3-3208953ce52f', 'b65fc2f5-181f-4ab5-9317-acb82806094b'] {{(pid=87204) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:02 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:56:02 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:02 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.704s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:56:02 devstack cinder-volume[87204]: INFO cinder.volume.manager [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Deleted volume successfully. Jul 09 16:56:02 devstack cinder-volume[87204]: DEBUG cinder.coordination [None req-02da19c7-2983-46f5-a141-3d87293bfc0e tempest-SnapshotDependencyTests-693631100 None] Lock "cinder-befc34fc-51f2-4f80-b031-e78a295fc638-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87204) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 16:56:12 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=7 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:56:12 devstack cinder-volume[87204]: DEBUG dbcounter [-] [87204] Writing DB stats cinder:SELECT=27,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 16:56:28 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:56:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 16:56:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 16:56:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31': None} {{(pid=87204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 16:56:28 devstack cinder-volume[87204]: DEBUG cinder.volume.drivers.quobyte [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b26f5b3e-a049-4934-92e6-6b4efcc6eb31'] {{(pid=87204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 16:56:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.lockutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 16:56:28 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 16:56:28 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5 Jul 09 16:56:28 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 16:56:29 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 09 16:56:29 devstack cinder-volume[87204]: DEBUG oslo_concurrency.processutils [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/10505b168de6ed6d21ef40acf87c37f5" returned: 0 in 0.649s {{(pid=87204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 16:56:29 devstack cinder-volume[87204]: DEBUG cinder.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Notifying Schedulers of capabilities ... {{(pid=87204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 16:56:29 devstack cinder-volume[87204]: DEBUG oslo_service.periodic_task [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] Running periodic task VolumeManager._thread_info {{(pid=87204) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 16:56:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread count: 28 {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 16:56:29 devstack cinder-volume[87204]: DEBUG cinder.volume.manager [None req-5773c115-a411-4723-853e-eaaf36aed521 None None] thread info: [<_MainThread(MainThread, started 132915627253888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87204) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}